00000001:02000400:3.0F:1787833573.122438:0:3293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787833596.076242:0:3515:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787833598.751182:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 437 MB/s 00000001:01000000:0.0F:1787833599.002291:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 533 MB/s 00000001:01000000:3.0:1787833599.252095:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8443 MB/s 00000020:02000000:0.0:1787833600.286237:0:3607:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_98_gaf12cc4 00000400:02000000:0.0:1787833601.549615:0:3622:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.117@tcp [8/256/0/180] 00008000:02000000:0.0:1787833606.104599:0:3771:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787833675.987325:0:5740:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787833691.662386:0:6490:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787833691.662393:0:6490:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787833691.662394:0:6490:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787833691.662501:0:6490:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000cd1d07aa 00000080:02000400:2.0:1787833691.662511:0:6490:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787833691.696318:0:6490:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787833691.696332:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787833691.696414:0:6490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008054eb67) 00000020:00000080:2.0:1787833691.696435:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787833691.844266:0:6490:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787833691.844353:0:6490:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787833691.879451:0:6490:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787833691.886999:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787833691.887018:0:6490:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787833691.887033:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1cdf3 00000020:01000004:3.0:1787833691.887042:0:6490:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787833691.887047:0:6490:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787833691.887054:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cd1d07aa from MGS 00000020:01000004:3.0:1787833691.887059:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787833691.887096:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001882ef6e) 00000020:00000080:3.0:1787833691.887110:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787833691.887229:0:6490:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cd1d07aa from MGS, refs=2 00080000:01000000:3.0:1787833691.887234:0:6490:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787833691.887239:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ce01 00000100:00100000:3.0:1787833691.887386:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787833691.887528:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787833691.887534:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787833691.891735:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787833691.891791:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787833691.892988:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833691.893203:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787833691.893209:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787833691.905031:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787833691.905054:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787833691.905571:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787833691.905578:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787833691.907269:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833691.907275:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833691.907277:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833691.907794:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833691.907799:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833691.907801:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833691.908594:0:6490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787833691.916148:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787833692.158096:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1623 MB/s 00000001:01000000:3.0:1787833692.409688:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2019 MB/s 00000001:01000000:0.0:1787833692.660108:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 501 MB/s 00000001:01000000:0.0:1787833692.910583:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 495 MB/s 00080000:10000000:2.0:1787833692.924031:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1787833692.946653:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787833692.956807:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787833692.957039:0:6490:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787833692.957095:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787833692.957348:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787833692.957375:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787833692.957704:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833692.957925:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787833692.957932:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:3.0:1787833692.961252:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833692.961583:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787833692.961594:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787833692.962060:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787833692.962068:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787833692.963143:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787833692.963168:0:6490:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.117@tcp' 00000020:01000004:0.0:1787833692.963170:0:6490:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787833692.963264:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.117@tcp (typ=mgc) 00000020:00000080:0.0:1787833692.963285:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.117@tcp (0000000094749ac4) 00000020:00000080:0.0:1787833692.963303:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787833692.963461:0:6490:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005dd94ddd@MGC192.168.203.117@tcp: add connection 192.168.203.117@tcp at head 00000100:00080000:2.0:1787833692.963704:0:6509:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1787833692.963933:0:6490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.117@tcp-0 is initialized 00000040:01000000:0.0:1787833692.963942:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787833692.971296:0:6511:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787833692.971469:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.117@tcp (uuid 3f2e78c7-534c-47b7-a20f-32c44fb24136) 00000020:00000080:0.0:1787833692.971497:0:6490:0:(genops.c:1385:class_connect()) connect: client 3f2e78c7-534c-47b7-a20f-32c44fb24136, cookie 0x996d2fb20dc1ce0f 00000100:00080000:0.0:1787833692.971510:0:6490:0:(import.c:510:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787833692.971516:0:6490:0:(import.c:624:import_select_connection()) MGC192.168.203.117@tcp: import 000000005dd94ddd using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787833692.971551:0:6490:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008ea14cdc x1874679406002304/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787833692.971584:0:6490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS 00000020:01000004:0.0:1787833692.971625:0:6490:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787833692.971630:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787833692.971642:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000004061fbc4) 00000020:00000080:0.0:1787833692.971655:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787833692.978969:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ea14cdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3f2e78c7-534c-47b7-a20f-32c44fb24136:3637:1874679406002304:0@lo:250: 00000100:00100000:2.0:1787833692.979067:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833692.979836:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406002304 00000100:00100000:2.0:1787833692.979847:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406002304 00000100:00100000:2.0:1787833692.979885:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833692.979891:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fc216cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1874679406002304:12345-0@lo:250: 00010000:00080000:2.0:1787833692.979918:0:6506:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 3f2e78c7-534c-47b7-a20f-32c44fb24136@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1787833692.979946:0:6506:0:(genops.c:1385:class_connect()) connect: client 3f2e78c7-534c-47b7-a20f-32c44fb24136, cookie 0x996d2fb20dc1ce1d 00000100:00080000:2.0:1787833692.980116:0:6506:0:(import.c:65:import_set_state_nolock()) 00000000bd0f21ad : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833692.980191:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fc216cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:3637:x1874679406002304:12345-0@lo:250: Request processed in 298us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.980200:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833692.980245:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787833692.980255:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.117@tcp: connect to target with instance 0 00000100:00080000:2.0:1787833692.980263:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787833692.980267:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787833692.980270:0:3637:0:(import.c:65:import_set_state_nolock()) 000000005dd94ddd MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787833692.980273:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787833692.980281:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787833692.980285:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ea14cdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3f2e78c7-534c-47b7-a20f-32c44fb24136:3637:1874679406002304:0@lo:250: 00000100:00100000:2.0:1787833692.998289:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833692.998518:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787833692.998525:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787833693.001454:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787833693.001483:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787833693.002095:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787833693.002105:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787833693.002884:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833693.003099:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787833693.003105:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787833693.003712:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787833693.003720:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787833693.061946:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833693.062168:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787833693.062175:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787833693.063477:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787833693.063490:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787833693.068581:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833693.068867:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787833693.068875:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787833693.069591:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787833693.069599:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787833693.070302:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833693.070487:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787833693.070492:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787833693.075739:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787833693.075798:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787833693.083506:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833693.084528:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787833693.084535:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787833693.091412:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787833693.091446:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787833693.116116:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787833693.116441:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787833693.116449:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787833693.118502:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787833693.118517:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787833693.120153:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787833693.120166:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787833693.121972:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787833693.122007:0:6490:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787833693.122015:0:6490:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787833693.122137:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787833693.122180:0:6490:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787833693.122184:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787833693.122186:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787833693.122187:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833693.122188:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833693.122189:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833693.122190:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833693.122192:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787833693.122193:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787833693.122194:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833693.122196:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833693.122197:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833693.122198:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787833693.122201:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787833693.122203:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787833693.122204:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787833693.122206:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833693.122207:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833693.122208:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833693.122209:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833693.122210:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787833693.122210:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787833693.122211:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833693.122212:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833693.122213:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833693.122219:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787833693.122246:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787833693.122265:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002432:0@lo:253: 00000100:00100000:1.0:1787833693.122351:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833693.122442:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a29cfe1a going to sleep for 11 seconds 00000100:00100000:2.0:1787833693.122531:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406002432 00000100:00100000:2.0:1787833693.122539:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406002432 00000100:00100000:2.0:1787833693.122632:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833693.122642:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009603af26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6490:x1874679406002432:12345-0@lo:253: 20000000:01000000:2.0:1787833693.122687:0:6508:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787833693.122690:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787833693.123287:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787833693.123361:0:6508:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787833693.123936:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833693.124843:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787833693.125480:0:6508:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787833693.125486:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787833693.125493:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787833693.125496:0:6508:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787833693.125509:0:6508:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787833693.125708:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787833693.125926:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787833693.125942:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787833693.125962:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787833693.125980:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787833693.126014:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787833693.126074:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787833693.126081:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787833693.126093:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787833693.126099:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787833693.126110:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787833693.126115:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787833693.126128:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787833693.126143:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787833693.126168:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787833693.126174:0:6508:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787833693.126180:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787833693.126266:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787833693.126277:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787833693.126298:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787833693.126312:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787833693.126323:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787833693.126331:0:6508:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787833693.126355:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787833693.126362:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787833693.126373:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787833693.126385:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787833693.126397:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787833693.126403:0:6508:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787833693.126423:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787833693.126429:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787833693.126441:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787833693.126466:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787833693.126516:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787833693.126533:0:6508:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787833693.126540:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787833693.127234:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787833693.127447:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787833693.127467:0:6508:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.117@tcp for mdt 20000000:01000000:2.0:1787833693.127469:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:2.0:1787833693.127481:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787833693.127485:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787833693.127496:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787833693.127500:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:2.0:1787833693.127511:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787833693.127517:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787833693.127528:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787833693.127540:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787833693.127564:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787833693.127567:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787833693.127571:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787833693.127695:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787833693.127697:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787833693.128081:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787833693.128230:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787833693.128250:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787833693.128262:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787833693.128271:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787833693.128272:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787833693.128884:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787833693.129049:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787833693.129070:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787833693.129086:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1787833693.129096:0:6508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787833693.129099:0:6508:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787833693.129103:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787833693.129105:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787833693.129110:0:6508:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787833693.129116:0:6508:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787833693.129377:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787833693.129483:0:6508:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787833693.138435:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787833693.138473:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787833693.138492:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787833693.138513:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787833693.138534:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138551:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138561:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138567:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138591:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138597:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138603:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e0ca524 already unused, calling callback (000000008ec170e8) 00010000:00010000:2.0:1787833693.138606:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138615:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138702:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138710:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.138717:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1ce24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787833693.138738:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787833693.169111:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009603af26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6490:x1874679406002432:12345-0@lo:253: Request processed in 46462us (46752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833693.169134:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787833693.169250:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002432:0@lo:253: 10000000:01000000:1.0:1787833693.169269:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787833693.169273:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787833693.169275:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787833693.169276:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833693.169277:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787833693.169278:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833693.169279:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833693.169280:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787833693.169281:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787833693.169283:0:6490:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787833693.169284:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833693.169286:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787833693.169304:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cd1d07aa from lustre-MDT0000 10000000:01000000:1.0:1787833693.169352:0:6490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787833693.169356:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787833693.169360:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df60ec73490 10000000:01000000:1.0:1787833693.169364:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787833693.169372:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df60ec73490 from 1 10000000:01000000:1.0:1787833693.169375:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787833693.169412:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.169422:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.169430:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833693.169458:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002560:0@lo:101: 00000100:00100000:1.0:1787833693.169491:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833693.169548:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f30110bb going to sleep for 11 seconds 00000100:00100000:3.0:1787833693.169603:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406002560 00000100:00100000:3.0:1787833693.169611:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406002560 00000100:00100000:3.0:1787833693.169662:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833693.169669:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000635ae059 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6490:x1874679406002560:12345-0@lo:101: 00010000:00010000:3.0:1787833693.169681:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833693.169695:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ce2b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.169716:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce2b expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.169726:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce2b expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.169734:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2f5b56c, rc 0) 00000100:00100000:3.0:1787833693.169817:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000635ae059 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:6490:x1874679406002560:12345-0@lo:101: Request processed in 148us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833693.169823:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787833693.169980:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002560:0@lo:101: 00010000:00010000:1.0:1787833693.169993:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.170001:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833693.170085:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002688:0@lo:501: 00000100:00100000:1.0:1787833693.170112:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833693.170139:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f30110bb going to sleep for 11 seconds 00000100:00100000:2.0:1787833693.170250:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406002688 00000100:00100000:2.0:1787833693.170255:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406002688 00000100:00100000:2.0:1787833693.170291:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833693.170298:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082e57d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:6490:x1874679406002688:12345-0@lo:501: 00000100:00100000:2.0:1787833693.170378:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082e57d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:6490:x1874679406002688:12345-0@lo:501: Request processed in 81us (265us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787833693.170396:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833693.170495:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002688:0@lo:501: 10000000:01000000:1.0:1787833693.170522:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787833693.170540:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.170548:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833693.170555:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df60efc3000 10000000:01000000:1.0:1787833693.170560:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787833693.170563:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df60efc3000 10000000:01000000:1.0:1787833693.170566:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787833693.170568:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df60efc3000 from 1 10000000:01000000:1.0:1787833693.170576:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787833693.170594:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 0000000047478acb/0x996d2fb20dc1ce39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.170601:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 0000000047478acb/0x996d2fb20dc1ce39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.170607:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 0000000047478acb/0x996d2fb20dc1ce39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833693.170631:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002816:0@lo:101: 00000100:00100000:1.0:1787833693.170658:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833693.170671:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f30110bb going to sleep for 11 seconds 00000100:00100000:3.0:1787833693.170801:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406002816 00000100:00100000:3.0:1787833693.170806:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406002816 00000100:00100000:3.0:1787833693.170830:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833693.170836:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e7c63e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:6490:x1874679406002816:12345-0@lo:101: 00010000:00010000:3.0:1787833693.170844:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833693.170855:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006dd54d10/0x996d2fb20dc1ce40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ce39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.170878:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006dd54d10/0x996d2fb20dc1ce40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce39 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.170886:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006dd54d10/0x996d2fb20dc1ce40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce39 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.170893:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006dd54d10, rc 0) 00000100:00100000:3.0:1787833693.170924:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e7c63e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+7:6490:x1874679406002816:12345-0@lo:101: Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833693.170930:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833693.171130:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002816:0@lo:101: 00010000:00010000:1.0:1787833693.171142:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 0000000047478acb/0x996d2fb20dc1ce39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.171149:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 0000000047478acb/0x996d2fb20dc1ce39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833693.171160:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787833693.171163:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 0000000047478acb/0x996d2fb20dc1ce39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.171169:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 0000000047478acb/0x996d2fb20dc1ce39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833693.171174:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787833693.171178:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787833693.171183:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df60efc3000 10000000:01000000:1.0:1787833693.171192:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787833693.171195:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787833693.171197:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787833693.171214:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.171221:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.171228:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833693.171241:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002944:0@lo:101: 00000100:00100000:1.0:1787833693.171267:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833693.171284:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f30110bb going to sleep for 11 seconds 00000100:00100000:3.0:1787833693.171348:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406002944 00000100:00100000:3.0:1787833693.171352:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406002944 00000100:00100000:3.0:1787833693.171380:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833693.171387:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009469249e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+7:6490:x1874679406002944:12345-0@lo:101: 00010000:00010000:3.0:1787833693.171394:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833693.171401:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ce47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.171415:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce47 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.171422:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce47 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.171428:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c15db2c, rc 0) 00000100:00100000:3.0:1787833693.171460:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009469249e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+8:6490:x1874679406002944:12345-0@lo:101: Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833693.171466:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833693.171497:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000caa471f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406002944:0@lo:101: 00010000:00010000:3.0:1787833693.171506:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.171513:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833693.171577:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003072:0@lo:501: 00000100:00100000:3.0:1787833693.171601:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.171608:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095a9dbe1 going to sleep for 11 seconds 00000100:00100000:3.0:1787833693.171638:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406003072 00000100:00100000:3.0:1787833693.171642:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406003072 00000100:00100000:3.0:1787833693.171657:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787833693.171662:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6ef4821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+8:6490:x1874679406003072:12345-0@lo:501: 00000100:00100000:3.0:1787833693.171796:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6ef4821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:6490:x1874679406003072:12345-0@lo:501: Request processed in 134us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833693.171803:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787833693.171842:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003072:0@lo:501: 00000100:00100000:3.0:1787833693.171879:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003200:0@lo:503: 00000100:00100000:3.0:1787833693.171915:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.171929:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095a9dbe1 going to sleep for 11 seconds 00000100:00100000:3.0:1787833693.171948:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406003200 00000100:00100000:3.0:1787833693.171952:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406003200 00000100:00100000:3.0:1787833693.171969:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787833693.171974:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c07b1cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:6490:x1874679406003200:12345-0@lo:503: 00000100:00100000:3.0:1787833693.172050:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c07b1cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:6490:x1874679406003200:12345-0@lo:503: Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833693.172065:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787833693.172097:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003200:0@lo:503: 00000100:00100000:2.0:1787833693.174926:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:6536:1874679406003328:0@lo:502: 00000100:00100000:2.0:1787833693.175018:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833693.175108:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e084c2b7 going to sleep for 11 seconds 00000100:00100000:3.0:1787833693.175291:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406003328 00000100:00100000:3.0:1787833693.175299:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406003328 00000100:00100000:3.0:1787833693.175887:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787833693.175898:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030ff659b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:6536:x1874679406003328:12345-0@lo:502: 00000100:00100000:3.0:1787833693.176035:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030ff659b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:6536:x1874679406003328:12345-0@lo:502: Request processed in 140us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833693.176042:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787833693.176147:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:6536:1874679406003328:0@lo:502: 00000020:01000000:0.0:1787833693.176183:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833693.176194:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833693.176196:0:6536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787833693.176202:0:6536:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787833693.176204:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787833693.176218:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000e9385cb) 00000020:00000080:0.0:1787833693.176236:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787833693.176240:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787833693.176328:0:6536:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787833693.176336:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ce5c 00000020:00000080:0.0:1787833693.176574:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787833693.176579:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833693.176582:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833693.176589:0:6536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787833693.176592:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833693.176596:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833693.176597:0:6536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787833693.176600:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787833693.176607:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c7ed30d6) 00000020:00000080:0.0:1787833693.176616:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787833693.176631:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787833693.176632:0:6536:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787833693.176635:0:6536:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787833693.176640:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787833693.176680:0:6536:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cd1d07aa from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787833693.176699:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003eb5c744) 00000020:00000080:0.0:1787833693.176708:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787833693.176830:0:6536:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787833693.176836:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1ce71 00000020:00000080:0.0:1787833693.176926:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787833693.176932:0:6536:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787833693.176936:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x996d2fb20dc1ce78 00080000:01000000:0.0:1787833693.176940:0:6536:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787833693.176943:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ce7f 00080000:10000000:0.0:1787833693.177360:0:6536:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787833693.177509:0:6536:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787833693.188002:0:6536:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787833693.290080:0:6536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787833693.291028:0:6536:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787833693.296584:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787833693.297137:0:6536:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787833693.306987:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002d236c3c) 00000020:00000080:0.0:1787833693.307014:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787833693.307122:0:6536:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787833693.307130:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ce8d 00000020:00000080:1.0:1787833693.307951:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787833693.308922:0:6536:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1787833693.315432:0:6536:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1787833693.318642:0:6536:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787833693.323871:0:6536:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1787833693.325736:0:6536:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1787833693.329437:0:6536:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1787833693.331949:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x996d2fb20dc1ce94 00000020:00000080:3.0:1787833693.332435:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787833693.332448:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833693.332456:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833693.332458:0:6536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787833693.332461:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833693.332465:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833693.332467:0:6536:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787833693.332469:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787833693.332471:0:6536:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787833693.332473:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833693.332476:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833693.332477:0:6536:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787833693.332479:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833693.332484:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833693.332485:0:6536:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787833693.332489:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787833693.332540:0:6536:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787833693.332602:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:6536:1874679406003456:0@lo:502: 00000100:00100000:3.0:1787833693.332698:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.332802:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set 000000004aa12bf5 going to sleep for 11 seconds 00000100:00100000:1.0:1787833693.332938:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406003456 00000100:00100000:1.0:1787833693.332946:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406003456 00000100:00100000:1.0:1787833693.333003:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787833693.333011:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c110364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:6536:x1874679406003456:12345-0@lo:502: 00000100:00100000:1.0:1787833693.333137:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c110364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:6536:x1874679406003456:12345-0@lo:502: Request processed in 127us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833693.333145:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833693.333306:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:6536:1874679406003456:0@lo:502: 00000020:01000000:3.0:1787833693.333337:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833693.333342:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833693.333344:0:6536:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787833693.333347:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787833693.333746:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787833693.333818:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787833693.333835:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.333846:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833693.333854:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60efc3000 from 1 10000000:01000000:2.0:1787833693.333857:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787833693.333895:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.333902:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.333911:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833693.333927:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003584:0@lo:101: 00000100:00100000:2.0:1787833693.333978:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833693.334016:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1bfdbb7 going to sleep for 11 seconds 00000100:00100000:3.0:1787833693.334192:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406003584 00000100:00100000:3.0:1787833693.334199:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406003584 00000100:00100000:3.0:1787833693.334240:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787833693.334249:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f0b284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:6490:x1874679406003584:12345-0@lo:101: 00010000:00010000:3.0:1787833693.334260:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833693.334272:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ce9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.334295:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce9b expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.334306:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce9b expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.334316:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3a4e37a, rc 0) 00000100:00100000:3.0:1787833693.334436:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f0b284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:6490:x1874679406003584:12345-0@lo:101: Request processed in 188us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833693.334444:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833693.334913:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003584:0@lo:101: 00010000:00010000:2.0:1787833693.334930:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.334939:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833693.335600:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003712:0@lo:256: 00000100:00100000:3.0:1787833693.336394:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.336449:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d061b0cf going to sleep for 11 seconds 00000100:00100000:2.0:1787833693.336809:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406003712 00000100:00100000:2.0:1787833693.336818:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406003712 00000100:00100000:2.0:1787833693.336871:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833693.336880:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003341a7e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:6490:x1874679406003712:12345-0@lo:256: 20000000:01000000:2.0:1787833693.336904:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787833693.336910:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787833693.337026:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003341a7e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:6490:x1874679406003712:12345-0@lo:256: Request processed in 147us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833693.337033:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787833693.337385:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003712:0@lo:256: 10000000:01000000:3.0:1787833693.338106:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787833693.338168:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.338180:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833693.338189:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df60efc3000 from 1 10000000:01000000:3.0:1787833693.338191:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833693.338227:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.338233:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.338242:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833693.338258:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003840:0@lo:101: 00000100:00100000:3.0:1787833693.338305:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.338400:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d061b0cf going to sleep for 11 seconds 00000100:00100000:0.0:1787833693.338720:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406003840 00000100:00100000:0.0:1787833693.338729:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406003840 00000100:00100000:0.0:1787833693.338912:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787833693.338921:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005832ea48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:6490:x1874679406003840:12345-0@lo:101: 00010000:00010000:0.0:1787833693.338935:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833693.338961:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cea9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833693.338987:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cea9 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833693.338996:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cea9 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833693.339004:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b20c161d, rc 0) 00000100:00100000:0.0:1787833693.339088:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005832ea48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:6490:x1874679406003840:12345-0@lo:101: Request processed in 168us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833693.339095:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787833693.339506:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003840:0@lo:101: 00010000:00010000:3.0:1787833693.339522:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.339530:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833693.339602:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003968:0@lo:501: 00000100:00100000:3.0:1787833693.339648:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.348248:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d061b0cf going to sleep for 11 seconds 00000100:00100000:2.0:1787833693.348521:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406003968 00000100:00100000:2.0:1787833693.348532:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406003968 00000100:00100000:2.0:1787833693.348582:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833693.348590:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000855f5f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:6490:x1874679406003968:12345-0@lo:501: 00000100:00100000:2.0:1787833693.348907:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000855f5f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:6490:x1874679406003968:12345-0@lo:501: Request processed in 317us (9258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833693.348916:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787833693.349097:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406003968:0@lo:501: 00000100:00100000:3.0:1787833693.349146:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004096:0@lo:503: 00000100:00100000:3.0:1787833693.349205:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.349240:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d061b0cf going to sleep for 11 seconds 00000100:00100000:2.0:1787833693.349284:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406004096 00000100:00100000:2.0:1787833693.349288:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406004096 00000100:00100000:2.0:1787833693.349440:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787833693.349456:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce31ee17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:6490:x1874679406004096:12345-0@lo:503: 00000040:00080000:2.0:1787833693.349487:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787833693.349535:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce31ee17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:6490:x1874679406004096:12345-0@lo:503: Request processed in 80us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833693.349542:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787833693.349608:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004096:0@lo:503: 00000040:00080000:3.0:1787833693.351680:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787833693.351814:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787833693.351837:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833693.351865:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.351880:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833693.351942:0:6490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787833693.351945:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df60efc3000 10000000:01000000:3.0:1787833693.351948:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df60efc3000 10000000:01000000:3.0:1787833693.351953:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787833693.351959:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df60efc3000 from 1 10000000:01000000:3.0:1787833693.351961:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787833693.351998:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.352006:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.352037:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833693.352058:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004224:0@lo:101: 00000100:00100000:3.0:1787833693.352123:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833693.362885:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406004224 00000100:00100000:1.0:1787833693.362906:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406004224 00000100:00100000:1.0:1787833693.363041:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833693.363050:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084d6950c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:6490:x1874679406004224:12345-0@lo:101: 00010000:00010000:1.0:1787833693.363086:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833693.363106:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ceb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.363134:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ceb7 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.363144:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ceb7 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.363153:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038529129, rc 0) 00000100:00100000:1.0:1787833693.363227:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084d6950c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6490:x1874679406004224:12345-0@lo:101: Request processed in 178us (11104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833693.363233:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787833693.364324:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b42228a going to sleep for 11 seconds 00000100:00100000:3.0:1787833693.364356:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004224:0@lo:101: 00010000:00010000:3.0:1787833693.364378:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.364389:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833693.364473:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004352:0@lo:501: 00000100:00100000:3.0:1787833693.364516:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.365121:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b42228a going to sleep for 11 seconds 00000100:00100000:0.0:1787833693.365179:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406004352 00000100:00100000:0.0:1787833693.365188:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406004352 00000100:00100000:0.0:1787833693.365361:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787833693.365371:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f4f427d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6490:x1874679406004352:12345-0@lo:501: 00000100:00100000:0.0:1787833693.365568:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f4f427d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6490:x1874679406004352:12345-0@lo:501: Request processed in 199us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833693.365905:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004352:0@lo:501: 00000100:00100000:3.0:1787833693.365951:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004480:0@lo:503: 00000100:00100000:3.0:1787833693.366005:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.366074:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b42228a going to sleep for 11 seconds 00000100:00100000:0.0:1787833693.366116:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787833693.366145:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406004480 00000100:00100000:0.0:1787833693.366149:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406004480 00000100:00100000:1.0:1787833693.366196:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787833693.366204:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003546dbdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6490:x1874679406004480:12345-0@lo:503: 00000100:00100000:1.0:1787833693.366307:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003546dbdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6490:x1874679406004480:12345-0@lo:503: Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833693.366314:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787833693.366386:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004480:0@lo:503: 00000100:00100000:3.0:1787833693.366994:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:6541:1874679406004608:0@lo:502: 00000100:00100000:3.0:1787833693.367037:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.367059:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031600260 going to sleep for 11 seconds 00000100:00100000:2.0:1787833693.367447:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406004608 00000100:00100000:2.0:1787833693.367455:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406004608 00000100:00100000:2.0:1787833693.367502:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787833693.367509:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f737dbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6541:x1874679406004608:12345-0@lo:502: 00000100:00100000:3.0:1787833693.367665:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:6541:1874679406004608:0@lo:502: 00000100:00100000:2.0:1787833693.367837:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f737dbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6541:x1874679406004608:12345-0@lo:502: Request processed in 328us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833693.367846:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:01000004:3.0:1787833693.367959:0:6541:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787833693.367975:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001029056a) 00000020:00000080:3.0:1787833693.367994:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787833693.368085:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cd1d07aa from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787833693.368089:0:6541:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000cd1d07aa from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787833693.368092:0:6541:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000cd1d07aa 4 00010000:00080000:3.0:1787833693.368130:0:6541:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006c89dc51@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1787833693.370558:0:6541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787833693.370847:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787833693.370901:0:6541:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787833693.370919:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x996d2fb20dc1cecc 00000100:00080000:3.0:1787833693.370931:0:6541:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787833693.370937:0:6541:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006c89dc51 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787833693.370977:0:6541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000058d01cb8 x1874679406004736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787833693.371005:0:6541:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787833693.371172:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406004736:0@lo:38: 00000100:00100000:0.0:1787833693.371266:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.371982:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c22acf6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:6541:1874679406004864:0@lo:502: 00000100:00100000:3.0:1787833693.372044:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833693.372079:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e07c5552 going to sleep for 11 seconds 00000100:00100000:1.0:1787833693.372240:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406004864 00000100:00100000:1.0:1787833693.372478:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406004864 00000100:00100000:1.0:1787833693.372644:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787833693.372656:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043b2a1de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6541:x1874679406004864:12345-0@lo:502: 00000100:00100000:1.0:1787833693.372907:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043b2a1de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6541:x1874679406004864:12345-0@lo:502: Request processed in 252us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833693.372916:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787833693.373101:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c22acf6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:6541:1874679406004864:0@lo:502: 00000040:00080000:0.0:1787833693.373134:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787833693.373842:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787833693.373873:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787833693.373891:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833693.373912:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787833693.373963:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787833693.373966:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787833693.373968:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787833693.373970:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787833693.373971:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787833693.373972:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787833693.373974:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787833693.373975:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787833693.373977:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787833693.373979:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787833693.373981:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787833693.373983:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787833693.373987:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787833693.373990:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787833693.373991:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787833693.373993:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787833693.373994:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787833693.373994:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787833693.373995:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787833693.373996:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787833693.373997:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787833693.373998:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787833693.373999:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787833693.374000:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787833693.374001:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787833693.374029:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787833693.374045:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed9dcd5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004992:0@lo:253: 00000100:00100000:0.0:1787833693.374104:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833693.375904:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406004736 00000100:00100000:2.0:1787833693.375921:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406004736 00000100:00100000:2.0:1787833693.375977:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833693.375984:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b54250a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406004736:12345-0@lo:38: 00000100:00100000:2.0:1787833693.376077:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b54250a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406004736:12345-0@lo:38: Request processed in 92us (4810us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787833693.376084:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833693.376130:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787833693.376138:0:3637:0:(import.c:65:import_set_state_nolock()) 000000006c89dc51 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787833693.376142:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787833693.376145:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406004736:0@lo:38: 00000100:00100000:0.0:1787833693.382190:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fcd15e1 going to sleep for 11 seconds 00000100:00100000:3.0:1787833693.387571:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406004992 00000100:00100000:3.0:1787833693.387593:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406004992 00000100:00100000:3.0:1787833693.387726:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787833693.387735:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c68c011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6490:x1874679406004992:12345-0@lo:253: 20000000:01000000:3.0:1787833693.387804:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787833693.387820:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787833693.397514:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787833693.397540:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787833693.397842:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787833693.397848:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787833693.397879:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.397898:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce9b expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.397906:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.397947:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ce9b expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833693.397965:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce9b expref: 12 pid: 6508 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833693.397984:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406005120:0@lo:104: 00000100:00100000:1.0:1787833693.398069:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833693.398123:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be4f05ee going to sleep for 11 seconds 00000100:00100000:0.0:1787833693.398353:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406005120 00000100:00100000:0.0:1787833693.398361:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406005120 00000100:00100000:0.0:1787833693.398414:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833693.398430:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007857f59d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6530:x1874679406005120:12345-0@lo:104: 00010000:00010000:0.0:1787833693.398443:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833693.398512:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833693.398518:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007857f59d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6530:x1874679406005120:12345-0@lo:104: Request processed in 90us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833693.398524:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787833693.398538:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833693.398544:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.398552:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e0ca524 already unused, calling callback (00000000945acc48) 10000000:00010000:2.0:1787833693.398567:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.398574:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833693.398581:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833693.398587:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833693.398630:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.398637:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833693.398664:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.398679:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1ce9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cea2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.398697:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833693.398698:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833693.398700:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833693.398854:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833693.398865:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406005248:0@lo:103: 00000100:00100000:1.0:1787833693.398900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833693.400110:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406005248 00000100:00100000:2.0:1787833693.400126:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406005248 00010000:00010000:2.0:1787833693.400161:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce9b expref: 13 pid: 6508 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833693.400203:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833693.400211:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096a0cafc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:3638:x1874679406005248:12345-0@lo:103: 00010000:00010000:2.0:1787833693.400224:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833693.400241:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce9b expref: 13 pid: 6508 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400251:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce9b expref: 13 pid: 6508 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400271:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400280:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787833693.400298:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002450091s 00010000:00010000:2.0:1787833693.400302:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400309:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400323:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400330:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400337:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000004e2a8bb already unused, calling callback (000000008ec170e8) 00010000:00010000:2.0:1787833693.400340:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400347:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400356:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833693.400374:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833693.400450:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096a0cafc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:3638:x1874679406005248:12345-0@lo:103: Request processed in 240us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833693.400457:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833693.400486:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406005248:0@lo:103: 00010000:00010000:3.0:1787833693.400662:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3a4e37a/0x996d2fb20dc1cea2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ce9b expref: 12 pid: 6508 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833693.400692:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406005120:0@lo:104: 00010000:00010000:3.0:1787833693.400706:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.400715:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.400721:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833693.400726:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000004e2a8bb/0x996d2fb20dc1ced3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833693.401341:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c68c011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:6490:x1874679406004992:12345-0@lo:253: Request processed in 13602us (27233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833693.401353:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787833693.401363:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed9dcd5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:6490:1874679406004992:0@lo:253: 10000000:01000000:1.0:1787833693.401375:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787833693.401378:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787833693.401380:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787833693.401382:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833693.401383:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833693.401384:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833693.401385:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833693.401386:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787833693.401395:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787833693.401396:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833693.401398:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833693.401399:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833693.401401:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787833693.401414:0:6490:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787833693.409822:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1787833693.410020:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787833693.410233:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1787833693.410393:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787833693.410593:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1787833693.410798:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787833693.418106:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1787833693.418381:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787833693.418965:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1787833693.419154:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787833693.419438:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1787833693.421269:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787833693.426244:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787833693.439191:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787833693.439434:0:6547:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787833693.441270:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787833693.441384:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787833693.442310:0:6490:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787833693.442365:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:3.0:1787833693.442902:0:6546:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787833693.442907:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1787833693.443093:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833693.445661:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787833693.446614:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787833693.446670:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787833693.447501:0:6547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833693.447616:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787833693.447986:0:6490:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1787833693.451874:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787833693.452112:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787833693.452262:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787833693.452887:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787833693.453036:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787833693.453188:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787833693.453856:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787833693.454031:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787833693.454194:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787833693.456150:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787833693.456608:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787833693.456894:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787833693.457044:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787833693.457164:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787833693.457314:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787833693.457555:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787833693.458181:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787833693.458466:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787833693.458607:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787833693.459106:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787833693.459248:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787833693.459492:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787833693.459614:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000040:00080000:0.0:1787833693.459922:0:6547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:1.0:1787833693.459947:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000004:00080000:0.0:1787833693.459993:0:6547:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787833693.459997:0:6547:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1787833693.460072:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787833693.460223:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787833693.460614:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787833693.461050:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787833693.461199:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787833693.461472:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787833693.461600:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787833693.462001:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787833693.462193:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1787833693.465873:0:6490:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787833693.465942:0:6490:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9fc9c18c7988 00100000:10000000:1.0:1787833693.465950:0:6490:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787833693.466541:0:6490:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787833693.466560:0:6490:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787833693.466582:0:6490:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787833693.466600:0:6490:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787833693.475221:0:6490:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787833693.475431:0:6490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787833693.978185:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833695.003059:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833696.022127:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833697.048878:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833698.070133:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787833698.306668:0:6791:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787833698.646283:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787833698.646293:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787833698.646296:0:37:0:(import.c:65:import_set_state_nolock()) 000000006c89dc51 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787833698.646309:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006c89dc51 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787833698.646329:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000ce4d865 x1874679406005504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787833698.646376:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406005504:0@lo:38: 00000100:00100000:1.0:1787833698.646459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833698.646470:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000651b6884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406005376:0@lo:400: 00000100:00100000:3.0:1787833698.646501:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833698.646523:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406005376 00000100:00100000:1.0:1787833698.646529:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406005376 00000100:00100000:3.0:1787833698.646532:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406005504 00000100:00100000:3.0:1787833698.646534:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406005504 00000100:00100000:3.0:1787833698.646561:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833698.646566:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000caa471f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406005504:12345-0@lo:38: 00010000:00080000:3.0:1787833698.646590:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1787833698.646621:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x996d2fb20dc1ceda 00000004:00100000:3.0:1787833698.646681:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787833698.646838:0:6515:0:(import.c:65:import_set_state_nolock()) 000000005551c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833698.646916:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000caa471f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874679406005504:12345-0@lo:38: Request processed in 348us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833698.646922:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787833698.647065:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000ce4d865 x1874679406005504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787833698.647079:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787833698.647085:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787833698.647089:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787833698.647092:0:3637:0:(import.c:65:import_set_state_nolock()) 000000006c89dc51 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787833698.647096:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406005504:0@lo:38: 10000000:01000000:2.0:1787833698.648689:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787833698.648697:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60efc3000 from 3 10000000:01000000:2.0:1787833698.648702:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787833698.648774:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833698.648786:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833698.648808:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833698.648831:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043a9b42f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406005632:0@lo:101: 00000100:00100000:2.0:1787833698.648910:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833698.660826:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd4610cc going to sleep for 11 seconds 00000100:00100000:1.0:1787833698.660939:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406005632 00000100:00100000:1.0:1787833698.660950:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406005632 00000100:00100000:1.0:1787833698.661000:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787833698.661903:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c695a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:3640:x1874679406005376:12345-0@lo:400: 00000100:00100000:1.0:1787833698.661995:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c695a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:3640:x1874679406005376:12345-0@lo:400: Request processed in 100us (15492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833698.662436:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787833698.662449:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001c164dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6511:x1874679406005632:12345-0@lo:101: 00010000:00010000:3.0:1787833698.662462:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833698.662481:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cee1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833698.662509:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cee1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833698.662521:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cee1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833698.662529:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000867b3bb2, rc 0) 00000100:00100000:3.0:1787833698.662573:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001c164dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:6511:x1874679406005632:12345-0@lo:101: Request processed in 129us (13664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833698.662691:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787833698.662798:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787833698.662849:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000651b6884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406005376:0@lo:400: 00000100:00100000:2.0:1787833698.662983:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043a9b42f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406005632:0@lo:101: 00010000:00010000:2.0:1787833698.663000:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833698.663010:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833698.663067:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043a9b42f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406005760:0@lo:256: 00000100:00100000:2.0:1787833698.663107:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833698.663185:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd4610cc going to sleep for 11 seconds 00000100:00100000:3.0:1787833698.671934:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406005760 00000100:00100000:3.0:1787833698.671952:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406005760 00000100:00100000:3.0:1787833698.672013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787833698.672024:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021460d6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6511:x1874679406005760:12345-0@lo:256: 20000000:01000000:3.0:1787833698.672051:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787833698.672068:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787833698.672071:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787833698.672434:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021460d6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:6511:x1874679406005760:12345-0@lo:256: Request processed in 412us (9326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833698.672442:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833698.673431:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043a9b42f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406005760:0@lo:256: 10000000:01000000:3.0:1787833698.673557:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787833698.673566:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833698.673576:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833699.094149:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787833699.478143:0:6843:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787833699.478391:0:6843:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787833700.119142:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833701.150936:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833702.165934:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787833702.586985:0:6945:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787833702.587252:0:6945:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787833703.190827:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833703.769056:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833703.769206:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833703.769227:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003173a227 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406006016:0@lo:400: 00000100:00100000:2.0:1787833703.769315:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833703.769473:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406006016 00000100:00100000:0.0:1787833703.769481:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406006016 00000100:00100000:0.0:1787833703.769536:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833703.769544:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000709928d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406006016:12345-0@lo:400: 00000100:00100000:0.0:1787833703.769603:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000709928d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406006016:12345-0@lo:400: Request processed in 59us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833703.769610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787833703.769652:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003173a227 x1874679406006016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833703.769666:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003173a227 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406006016:0@lo:400: 00000100:00100000:2.0:1787833703.773372:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd8f39cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406005888:0@lo:400: 00000100:00100000:2.0:1787833703.773462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833703.776000:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406005888 00000100:00100000:1.0:1787833703.776016:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406005888 00000100:00100000:2.0:1787833703.776902:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787833703.776912:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b8a8b2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:3640:x1874679406005888:12345-0@lo:400: 00000100:00100000:2.0:1787833703.777005:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b8a8b2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:3640:x1874679406005888:12345-0@lo:400: Request processed in 94us (3543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833703.777027:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833703.777829:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd8f39cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406005888:0@lo:400: 00010000:00010000:3.0:1787833704.213928:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833705.243665:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833706.268344:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833707.286035:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833708.310401:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833708.887009:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dcc103e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406006272:0@lo:400: 00000100:00100000:3.0:1787833708.887103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833708.887133:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c96568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406006144:0@lo:400: 00000100:00100000:2.0:1787833708.887170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833708.887180:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406006272 00000100:00100000:3.0:1787833708.887187:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406006272 00000100:00100000:2.0:1787833708.887224:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406006144 00000100:00100000:2.0:1787833708.887228:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406006144 00000100:00100000:3.0:1787833708.887233:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833708.887240:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff60a8c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406006272:12345-0@lo:400: 00000100:00100000:2.0:1787833708.887254:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787833708.887259:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000402ab346 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:3639:x1874679406006144:12345-0@lo:400: 00000100:00100000:3.0:1787833708.887291:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff60a8c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406006272:12345-0@lo:400: Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.887291:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000402ab346 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:3639:x1874679406006144:12345-0@lo:400: Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833708.887299:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833708.887299:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787833708.887348:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000dcc103e x1874679406006272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833708.887348:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c96568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406006144:0@lo:400: 00000100:00100000:3.0:1787833708.887360:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dcc103e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406006272:0@lo:400: 00010000:00010000:3.0:1787833709.333957:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833710.358473:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833711.391490:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833712.405906:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833713.433964:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833714.007247:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8dee329 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406006400:0@lo:400: 00000100:00100000:1.0:1787833714.007328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.007434:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406006400 00000100:00100000:3.0:1787833714.007441:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406006400 00000100:00100000:3.0:1787833714.007490:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833714.007498:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fb535be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:3641:x1874679406006400:12345-0@lo:400: 00000100:00100000:0.0:1787833714.008034:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833714.008049:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406006528:0@lo:400: 00000100:00100000:0.0:1787833714.008101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.008137:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406006528 00000100:00100000:0.0:1787833714.008141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406006528 00000100:00100000:0.0:1787833714.008175:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833714.008180:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003173a227 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406006528:12345-0@lo:400: 00000100:00100000:0.0:1787833714.008220:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003173a227 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406006528:12345-0@lo:400: Request processed in 40us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.008227:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787833714.008262:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000012e6b685 x1874679406006528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833714.008277:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406006528:0@lo:400: 00000100:00100000:3.0:1787833714.010713:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fb535be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:3641:x1874679406006400:12345-0@lo:400: Request processed in 3209us (3379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.010728:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787833714.014068:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8dee329 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406006400:0@lo:400: 00000020:01000004:3.0:1787833714.028458:0:7443:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787833714.028463:0:7443:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787833714.028465:0:7443:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787833714.028645:0:7443:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000103928a5 00000020:01000004:3.0:1787833714.028662:0:7443:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1787833714.028672:0:7443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787833714.028686:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000091523edf) 00000020:00000080:3.0:1787833714.028699:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787833714.145740:0:7443:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1787833714.145887:0:7443:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1787833714.175171:0:7443:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787833714.175407:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787833714.175418:0:7443:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787833714.175430:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1cef6 00000020:01000004:3.0:1787833714.175436:0:7443:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787833714.175458:0:7443:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787833714.175461:0:7443:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787833714.175468:0:7443:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787833714.175908:0:7443:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787833714.175914:0:7443:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787833714.234216:0:7443:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787833714.234259:0:7443:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.117@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1787833714.234263:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787833714.234265:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787833714.234267:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833714.234268:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833714.234269:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833714.234270:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833714.234271:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787833714.234273:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833714.234275:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833714.234276:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833714.234277:0:7443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833714.234280:0:7443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1787833714.234282:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787833714.234284:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787833714.234285:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833714.234286:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833714.234287:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833714.234292:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833714.234293:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787833714.234294:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833714.234294:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833714.234295:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833714.234296:0:7443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833714.234324:0:7443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787833714.234342:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406006656:0@lo:253: 00000100:00100000:2.0:1787833714.234412:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.234465:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000003bbf3a04 going to sleep for 11 seconds 00000100:00100000:0.0:1787833714.234570:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406006656 00000100:00100000:0.0:1787833714.234578:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406006656 00000100:00100000:0.0:1787833714.234640:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787833714.234648:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015be6a4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:7443:x1874679406006656:12345-0@lo:253: 20000000:01000000:0.0:1787833714.234676:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787833714.234681:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1787833714.234686:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1787833714.234689:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1787833714.234721:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1787833714.234954:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833714.235095:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787833714.235107:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787833714.235123:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1787833714.235139:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1787833714.235152:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1787833714.235207:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1787833714.235214:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1787833714.235238:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1787833714.235244:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1787833714.235255:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1787833714.235259:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1787833714.235270:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1787833714.235284:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1787833714.235373:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1787833714.235382:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:0.0:1787833714.235394:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1787833714.235400:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787833714.235413:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1787833714.235417:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:0.0:1787833714.235430:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1787833714.235435:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787833714.235447:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1787833714.235462:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1787833714.235472:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787833714.235544:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1787833714.235552:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1787833714.235565:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1787833714.235580:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1787833714.235595:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1787833714.235602:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1787833714.235615:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1787833714.235651:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1787833714.235658:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1787833714.235678:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787833714.235684:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1787833714.236322:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787833714.236540:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787833714.236559:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.117@tcp for mdt 20000000:01000000:1.0:1787833714.236561:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:1.0:1787833714.236576:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787833714.236584:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787833714.236597:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787833714.236603:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:1.0:1787833714.236619:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787833714.236637:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1787833714.236663:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1787833714.236679:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1787833714.236731:0:6507:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1787833714.236739:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1787833714.237088:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1787833714.237239:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787833714.237255:0:6507:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.117@tcp for mdt 20000000:01000000:3.0:1787833714.237256:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:3.0:1787833714.237282:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787833714.237289:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787833714.237302:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787833714.237308:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:3.0:1787833714.237319:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787833714.237326:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1787833714.237338:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787833714.237353:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1787833714.237374:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787833714.237377:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787833714.237381:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787833714.237427:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787833714.237429:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787833714.237889:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787833714.237907:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787833714.237921:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787833714.238047:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1787833714.238065:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1787833714.238078:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1787833714.238090:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787833714.238092:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787833714.241212:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787833714.241263:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787833714.241297:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787833714.241540:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787833714.241564:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787833714.241594:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787833714.241607:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787833714.241610:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787833714.242262:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787833714.242286:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787833714.242298:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1787833714.242440:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787833714.242459:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787833714.242487:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1787833714.242503:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787833714.242506:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787833714.242512:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787833714.242518:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787833714.242993:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1787833714.243136:0:6507:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787833714.258344:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787833714.259982:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.260010:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce2b expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.260017:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ce47 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.260023:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ceb7 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.260030:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.260078:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ceb7 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.260091:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ceb7 expref: 12 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.260103:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406006784:0@lo:104: 00000100:00100000:0.0:1787833714.260178:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833714.260244:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ce47 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.260252:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce47 expref: 12 pid: 6508 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.260259:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd8f39cb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406006912:0@lo:104: 00000100:00100000:0.0:1787833714.260297:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833714.260362:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ce2b expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.260370:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce2b expref: 12 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.260376:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000331bd848 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406007040:0@lo:104: 00000100:00100000:0.0:1787833714.260394:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.266404:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 000000007177d4e7 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.268682:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406006784 00000100:00100000:2.0:1787833714.268698:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406006784 00000100:00100000:3.0:1787833714.268883:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406006912 00000100:00100000:3.0:1787833714.268888:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406006912 00000100:00100000:3.0:1787833714.268901:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406007040 00000100:00100000:3.0:1787833714.268903:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406007040 00000100:00100000:3.0:1787833714.268929:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833714.268944:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082630e91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6507:x1874679406006784:12345-0@lo:104: 00010000:00010000:3.0:1787833714.268994:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.269099:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787833714.269104:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082630e91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6507:x1874679406006784:12345-0@lo:104: Request processed in 162us (8927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.269111:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833714.269129:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833714.269135:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d2ded21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6507:x1874679406006912:12345-0@lo:104: 00010000:00010000:3.0:1787833714.269143:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.269176:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787833714.269180:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d2ded21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6507:x1874679406006912:12345-0@lo:104: Request processed in 47us (8884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.269185:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787833714.269200:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833714.269205:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.269211:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b29f80d6 already unused, calling callback (00000000945acc48) 10000000:00010000:3.0:1787833714.269214:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.269221:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833714.269226:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833714.269240:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833714.269283:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.269290:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833714.269304:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.269309:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833714.269311:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 00000000b29f80d6/0x996d2fb20dc1ceb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cebe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.269328:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833714.269329:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833714.269331:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833714.269351:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787833714.269358:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed9dcd5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6507:x1874679406007040:12345-0@lo:104: 00010000:00010000:3.0:1787833714.269365:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.269401:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787833714.269405:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed9dcd5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6507:x1874679406007040:12345-0@lo:104: Request processed in 50us (9012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.269411:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787833714.269427:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833714.269430:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.269437:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001fb53028 already unused, calling callback (00000000945acc48) 10000000:00010000:3.0:1787833714.269445:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.269452:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833714.269457:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833714.269463:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787833714.269634:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dcc103e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406007168:0@lo:103: 00010000:00010000:1.0:1787833714.269649:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833714.269657:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.269685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.269742:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406007168 00000100:00100000:0.0:1787833714.269746:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406007168 00010000:00010000:0.0:1787833714.269794:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ceb7 expref: 13 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.269817:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833714.269823:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ea14cdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:3639:x1874679406007168:12345-0@lo:103: 00010000:00010000:0.0:1787833714.269832:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833714.269836:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ceb7 expref: 13 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.269845:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ceb7 expref: 13 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.269863:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833714.269890:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ea14cdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:3639:x1874679406007168:12345-0@lo:103: Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.269905:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833714.269939:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dcc103e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406007168:0@lo:103: 00010000:00010000:0.0:1787833714.269988:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038529129/0x996d2fb20dc1cebe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ceb7 expref: 12 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.270000:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406006784:0@lo:104: 00000100:00100000:0.0:1787833714.270014:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd8f39cb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406006912:0@lo:104: 00000100:00100000:0.0:1787833714.270021:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000331bd848 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406007040:0@lo:104: 00010000:00010000:0.0:1787833714.270036:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.270214:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000049c8b92c already unused, calling callback (00000000945acc48) 10000000:00010000:1.0:1787833714.270220:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.270224:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.270229:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.270238:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1787833714.270253:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.270256:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833714.270263:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833714.270268:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 000000001fb53028/0x996d2fb20dc1ce2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ce32 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.270279:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833714.270281:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833714.270282:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833714.270288:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.270292:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c96568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406007296:0@lo:103: 00010000:00010000:1.0:1787833714.270301:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833714.270308:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.270315:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1ce47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ce4e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.270324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.270347:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833714.270352:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002f20cac4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406007424:0@lo:103: 00000100:00100000:3.0:1787833714.270370:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833714.270392:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833714.270394:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833714.270396:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833714.270407:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833714.270409:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833714.270619:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406007296 00000100:00100000:0.0:1787833714.270633:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406007296 00010000:00010000:0.0:1787833714.270651:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce2b expref: 12 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.270680:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406007424 00000100:00100000:0.0:1787833714.270684:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406007424 00010000:00010000:0.0:1787833714.270693:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce47 expref: 13 pid: 6508 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.270705:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833714.270710:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f261717 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:3640:x1874679406007296:12345-0@lo:103: 00010000:00010000:0.0:1787833714.270718:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833714.270721:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce2b expref: 13 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270729:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce2b expref: 13 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270779:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f2f5b56c/0x996d2fb20dc1ce32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ce2b expref: 13 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270792:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833714.270827:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f261717 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:3640:x1874679406007296:12345-0@lo:103: Request processed in 118us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.270834:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833714.270847:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787833714.270852:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000804589c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:3640:x1874679406007424:12345-0@lo:103: 00010000:00010000:0.0:1787833714.270859:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833714.270863:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce47 expref: 11 pid: 6508 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270870:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ce47 expref: 11 pid: 6508 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270879:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c15db2c/0x996d2fb20dc1ce4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ce47 expref: 11 pid: 6508 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270889:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270897:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270909:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270916:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270943:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270958:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270963:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000086cbbc79 already unused, calling callback (000000008ec170e8) 00010000:00010000:0.0:1787833714.270967:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270973:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270987:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.270996:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833714.271019:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000804589c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:3640:x1874679406007424:12345-0@lo:103: Request processed in 167us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.271025:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787833714.271053:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.271059:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.271064:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000086cbbc79/0x996d2fb20dc1cefd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787833714.271079:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787833714.272278:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002f20cac4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406007424:0@lo:103: 00000100:00100000:3.0:1787833714.272292:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c96568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406007296:0@lo:103: 00000100:00100000:2.0:1787833714.275258:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015be6a4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:7443:x1874679406006656:12345-0@lo:253: Request processed in 40601us (40837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.275276:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787833714.275366:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406006656:0@lo:253: 10000000:01000000:0.0:1787833714.275381:0:7443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787833714.275384:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787833714.275386:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787833714.275388:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787833714.275389:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1787833714.275390:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787833714.275392:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787833714.275393:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787833714.275394:0:7443:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787833714.275396:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787833714.275397:0:7443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787833714.275420:0:7443:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000103928a5 from lustre-MDT0001 10000000:01000000:0.0:1787833714.275447:0:7443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787833714.275450:0:7443:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787833714.275457:0:7443:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df60ec73490 local copy 10000000:01000000:0.0:1787833714.275461:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787833714.275558:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.275569:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.275577:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.275592:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000331bd848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406007552:0@lo:101: 00000100:00100000:0.0:1787833714.275634:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.275696:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000002dd11dd3 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.275728:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406007552 00000100:00100000:3.0:1787833714.275733:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406007552 00000100:00100000:3.0:1787833714.275904:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787833714.275912:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc35da30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:7443:x1874679406007552:12345-0@lo:101: 00010000:00010000:3.0:1787833714.275935:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833714.276146:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c7bad18/0x996d2fb20dc1cf0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cf04 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.276195:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c7bad18/0x996d2fb20dc1cf0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf04 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.276205:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c7bad18/0x996d2fb20dc1cf0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf04 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.276214:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c7bad18, rc 0) 00000100:00100000:3.0:1787833714.276253:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc35da30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:7443:x1874679406007552:12345-0@lo:101: Request processed in 342us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.276259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787833714.276318:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000331bd848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406007552:0@lo:101: 00010000:00010000:0.0:1787833714.276329:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.276347:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.276429:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000331bd848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406007680:0@lo:501: 00000100:00100000:0.0:1787833714.276452:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.276604:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000002dd11dd3 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.279496:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406007680 00000100:00100000:2.0:1787833714.279513:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406007680 00000100:00100000:2.0:1787833714.279588:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787833714.279597:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000117f5b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:7443:x1874679406007680:12345-0@lo:501: 00000100:00100000:2.0:1787833714.279810:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000117f5b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:7443:x1874679406007680:12345-0@lo:501: Request processed in 215us (3356us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787833714.279818:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787833714.279889:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000331bd848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406007680:0@lo:501: 10000000:01000000:2.0:1787833714.279910:0:7443:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787833714.279945:0:7443:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787833714.279961:0:7443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.279972:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.279989:0:7443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280008:0:7443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787833714.280048:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df63b1db800 10000000:01000000:2.0:1787833714.280053:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787833714.280059:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df60ec73490 10000000:01000000:2.0:1787833714.280062:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787833714.280065:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df60ec73490 from 1 10000000:01000000:2.0:1787833714.280068:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787833714.280097:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 0000000026f09ab0/0x996d2fb20dc1cf12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280104:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 0000000026f09ab0/0x996d2fb20dc1cf12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280113:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 0000000026f09ab0/0x996d2fb20dc1cf12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833714.280130:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406007808:0@lo:101: 00000100:00100000:2.0:1787833714.280163:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.280189:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406007808 00000100:00100000:2.0:1787833714.280193:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406007808 00000100:00100000:2.0:1787833714.280210:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787833714.280216:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000997e91db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:7443:x1874679406007808:12345-0@lo:101: 00010000:00010000:2.0:1787833714.280223:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833714.280234:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e227f663/0x996d2fb20dc1cf19 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cf12 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280264:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e227f663/0x996d2fb20dc1cf19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf12 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280273:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e227f663/0x996d2fb20dc1cf19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf12 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280282:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e227f663, rc 0) 00000100:00100000:2.0:1787833714.280307:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000997e91db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:7443:x1874679406007808:12345-0@lo:101: Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.280312:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787833714.280347:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000552eac92 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.280361:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406007808:0@lo:101: 00010000:00010000:2.0:1787833714.280372:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 0000000026f09ab0/0x996d2fb20dc1cf12 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf19 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280379:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 0000000026f09ab0/0x996d2fb20dc1cf12 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cf19 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833714.280397:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787833714.280406:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 0000000026f09ab0/0x996d2fb20dc1cf12 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf19 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280413:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 0000000026f09ab0/0x996d2fb20dc1cf12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf19 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833714.280419:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df63b1db800 10000000:01000000:2.0:1787833714.280434:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787833714.280438:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df63b1db800 from 1 10000000:01000000:2.0:1787833714.280445:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787833714.280459:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000b20b6f69/0x996d2fb20dc1cf20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280465:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000b20b6f69/0x996d2fb20dc1cf20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280471:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000b20b6f69/0x996d2fb20dc1cf20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833714.280481:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406007936:0@lo:101: 00000100:00100000:2.0:1787833714.280504:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.280522:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406007936 00000100:00100000:2.0:1787833714.280525:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406007936 00000100:00100000:2.0:1787833714.280540:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787833714.280545:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff6cf51b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:7443:x1874679406007936:12345-0@lo:101: 00010000:00010000:2.0:1787833714.280551:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833714.280558:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a8b08a4/0x996d2fb20dc1cf27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cf20 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280570:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a8b08a4/0x996d2fb20dc1cf27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf20 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280577:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a8b08a4/0x996d2fb20dc1cf27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf20 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280582:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a8b08a4, rc 0) 00000100:00100000:2.0:1787833714.280603:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff6cf51b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:7443:x1874679406007936:12345-0@lo:101: Request processed in 58us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.280608:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787833714.280649:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000552eac92 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.280660:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406007936:0@lo:101: 00010000:00010000:2.0:1787833714.280668:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000b20b6f69/0x996d2fb20dc1cf20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280674:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000b20b6f69/0x996d2fb20dc1cf20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833714.280684:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787833714.280689:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000b20b6f69/0x996d2fb20dc1cf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280695:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000b20b6f69/0x996d2fb20dc1cf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833714.280699:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787833714.280709:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787833714.280714:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df63b1db800 10000000:01000000:2.0:1787833714.280716:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787833714.280719:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787833714.280720:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787833714.280730:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000c29a2fa5/0x996d2fb20dc1cf2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280736:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000c29a2fa5/0x996d2fb20dc1cf2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280743:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000c29a2fa5/0x996d2fb20dc1cf2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833714.280771:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008064:0@lo:101: 00000100:00100000:2.0:1787833714.280801:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.280816:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406008064 00000100:00100000:2.0:1787833714.280820:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406008064 00000100:00100000:2.0:1787833714.280835:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787833714.280839:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000186205c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:7443:x1874679406008064:12345-0@lo:101: 00010000:00010000:2.0:1787833714.280845:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833714.280852:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cf9842e0/0x996d2fb20dc1cf35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cf2e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280863:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf9842e0/0x996d2fb20dc1cf35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf2e expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280868:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cf9842e0/0x996d2fb20dc1cf35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf2e expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280874:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cf9842e0, rc 0) 00000100:00100000:2.0:1787833714.280894:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000186205c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406008064:12345-0@lo:101: Request processed in 55us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.280900:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787833714.280921:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000552eac92 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.280931:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008064:0@lo:101: 00010000:00010000:2.0:1787833714.280939:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000c29a2fa5/0x996d2fb20dc1cf2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.280946:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000c29a2fa5/0x996d2fb20dc1cf2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833714.281024:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008192:0@lo:501: 00000100:00100000:2.0:1787833714.281057:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.281076:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406008192 00000100:00100000:2.0:1787833714.281079:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406008192 00000100:00100000:2.0:1787833714.281095:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833714.281100:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b146e4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406008192:12345-0@lo:501: 00000100:00100000:2.0:1787833714.281197:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b146e4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406008192:12345-0@lo:501: Request processed in 97us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.281204:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833714.281226:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000552eac92 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.281236:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008192:0@lo:501: 00000100:00100000:2.0:1787833714.281261:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008320:0@lo:503: 00000100:00100000:2.0:1787833714.281300:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.281319:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406008320 00000100:00100000:2.0:1787833714.281322:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406008320 00000100:00100000:2.0:1787833714.281338:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787833714.281343:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007961f4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406008320:12345-0@lo:503: 00000100:00100000:2.0:1787833714.281408:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007961f4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406008320:12345-0@lo:503: Request processed in 65us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.281414:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787833714.281443:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000552eac92 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.281454:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008320:0@lo:503: 00000040:00080000:2.0:1787833714.281714:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787833714.281825:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008448:0@lo:502: 00000100:00100000:2.0:1787833714.281861:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.281885:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406008448 00000100:00100000:2.0:1787833714.281889:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406008448 00000100:00100000:2.0:1787833714.281914:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787833714.281919:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dfc579c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406008448:12345-0@lo:502: 00000100:00100000:2.0:1787833714.281989:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dfc579c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406008448:12345-0@lo:502: Request processed in 70us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.281996:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787833714.282023:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000552eac92 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.282035:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008448:0@lo:502: 00000040:00080000:2.0:1787833714.282249:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787833714.282274:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1787833714.282287:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1787833714.282300:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1787833714.282311:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1787833714.282323:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1787833714.282334:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1787833714.282346:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1787833714.282357:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1787833714.282368:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1787833714.282381:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1787833714.282393:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1787833714.282404:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1787833714.282416:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1787833714.282428:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1787833714.282439:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1787833714.282465:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1787833714.282477:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1787833714.282488:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1787833714.282500:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1787833714.282509:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1787833714.282519:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1787833714.282528:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1787833714.282545:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008576:0@lo:502: 00000100:00100000:2.0:1787833714.282583:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.282609:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406008576 00000100:00100000:2.0:1787833714.282613:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406008576 00010000:00010000:3.0:1787833714.285679:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833714.285693:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.285705:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e32efafd already unused, calling callback (00000000945acc48) 10000000:00010000:3.0:1787833714.285709:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.285717:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833714.285748:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833714.285771:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833714.285812:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.285818:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787833714.286079:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c96568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406008704:0@lo:103: 00000100:00100000:0.0:1787833714.286157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.286224:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406008704 00000100:00100000:0.0:1787833714.286232:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406008704 00010000:00010000:3.0:1787833714.286262:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.286271:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 00000000e32efafd/0x996d2fb20dc1cf04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x996d2fb20dc1cf0b expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.286277:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833714.286287:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8f39cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:3638:x1874679406008704:12345-0@lo:103: 00010000:00010000:3.0:1787833714.286288:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833714.286291:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833714.286295:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833714.286304:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833714.286320:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002c7bad18/0x996d2fb20dc1cf0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1cf04 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.286333:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833714.286366:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8f39cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:3638:x1874679406008704:12345-0@lo:103: Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.286374:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833714.286411:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c96568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406008704:0@lo:103: 00000100:00100000:3.0:1787833714.290822:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000552eac92 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.292703:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787833714.292857:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce39b6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:7443:x1874679406008576:12345-0@lo:502: 00000100:00100000:2.0:1787833714.293278:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce39b6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:7443:x1874679406008576:12345-0@lo:502: Request processed in 563us (10693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.293287:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787833714.293424:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e01de32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406008576:0@lo:502: 00000040:00080000:3.0:1787833714.298554:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787833714.298582:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1787833714.303869:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833714.303888:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833714.303891:0:7456:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787833714.303897:0:7456:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787833714.303900:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833714.303916:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000085d92c34) 00000020:00000080:3.0:1787833714.303952:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1787833714.303958:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787833714.304069:0:7456:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787833714.304077:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1cf43 00000020:00000080:3.0:1787833714.304331:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787833714.304335:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833714.304338:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833714.304340:0:7456:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787833714.304342:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833714.304346:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833714.304347:0:7456:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787833714.304350:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833714.304365:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000032c8bbf0) 00000020:00000080:3.0:1787833714.304376:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1787833714.304381:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787833714.304383:0:7456:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787833714.304386:0:7456:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787833714.304392:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787833714.304444:0:7456:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000103928a5 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787833714.304457:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000a71dd0ab) 00000020:00000080:3.0:1787833714.304466:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1787833714.304537:0:7456:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787833714.304542:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1cf58 00000020:00000080:3.0:1787833714.304655:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787833714.304663:0:7456:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787833714.304667:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x996d2fb20dc1cf5f 00080000:01000000:3.0:1787833714.304673:0:7456:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787833714.304675:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1cf66 00080000:10000000:3.0:1787833714.306034:0:7456:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787833714.306189:0:7456:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1787833714.401275:0:7456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1787833714.401928:0:7456:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1787833714.405274:0:7456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787833714.406102:0:7456:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787833714.419292:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787833714.419308:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833714.419315:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833714.419317:0:7456:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787833714.419321:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833714.419339:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833714.419340:0:7456:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787833714.419343:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787833714.419348:0:7456:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:00000080:3.0:1787833714.419376:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833714.419390:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000007b482342) 00000020:00000080:3.0:1787833714.419413:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787833714.419419:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787833714.419504:0:7456:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787833714.419510:0:7456:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787833714.419517:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1cf74 00010000:00080000:3.0:1787833714.419552:0:7456:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000077fb2afd@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1787833714.425519:0:7456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1787833714.427871:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787833714.427889:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787833714.428060:0:7456:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787833714.428082:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1cf7b 00000100:00080000:1.0:1787833714.428093:0:7456:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787833714.428098:0:7456:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000077fb2afd using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787833714.428140:0:7456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000303186b0 x1874679406008832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787833714.428164:0:7456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787833714.428223:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833714.428227:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833714.428229:0:7456:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787833714.428232:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787833714.428234:0:7456:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787833714.428236:0:7456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787833714.428237:0:7456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787833714.428239:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787833714.428241:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833714.428242:0:7456:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787833714.428244:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833714.428248:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833714.428249:0:7456:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787833714.428253:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787833714.428282:0:7456:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787833714.428295:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833714.428297:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833714.428298:0:7456:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787833714.428300:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833714.428302:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833714.428303:0:7456:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787833714.428305:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787833714.428306:0:7456:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787833714.428332:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833714.428334:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833714.428335:0:7456:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787833714.428338:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1787833714.428457:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000303186b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406008832:0@lo:38: 00000100:00100000:1.0:1787833714.428731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787833714.428954:0:7443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1787833714.428986:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787833714.429000:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000c29a2fa5/0x996d2fb20dc1cf2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.429022:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000c29a2fa5/0x996d2fb20dc1cf2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833714.429031:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df63b1db800 from 1 10000000:01000000:0.0:1787833714.429034:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787833714.429059:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.429066:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.429075:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.429089:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f375c51e pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009088:0@lo:101: 00000100:00100000:0.0:1787833714.429121:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.429138:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000afc8d52e going to sleep for 11 seconds 00000100:00100000:0.0:1787833714.429162:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406008832 00000100:00100000:0.0:1787833714.429168:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406008832 00000100:00100000:0.0:1787833714.429198:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833714.429203:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070d55b5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406008832:12345-0@lo:38: 00010000:00080000:0.0:1787833714.429235:0:6519:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1787833714.429266:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1cf89 00000004:00100000:0.0:1787833714.429279:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787833714.429285:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787833714.429353:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833714.429361:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406008960:0@lo:400: 00000100:00100000:0.0:1787833714.429401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.429433:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406009088 00000100:00100000:0.0:1787833714.429437:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406009088 00000100:00100000:0.0:1787833714.429468:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787833714.429489:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e180ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+12:7443:x1874679406009088:12345-0@lo:101: 00010000:00010000:0.0:1787833714.429501:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833714.429513:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cf82 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.429534:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf82 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.429543:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf82 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.429551:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001479d797, rc 0) 00000100:00100000:0.0:1787833714.430033:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e180ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406009088:12345-0@lo:101: Request processed in 543us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.430040:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787833714.430082:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406008960 00000100:00100000:0.0:1787833714.430086:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406008960 00000100:00100000:0.0:1787833714.430113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787833714.430118:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000932dc20d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406008960:12345-0@lo:400: 00000100:00100000:0.0:1787833714.430155:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000932dc20d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406008960:12345-0@lo:400: Request processed in 37us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.430161:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787833714.430199:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000012e6b685 x1874679406008960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833714.430226:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406008960:0@lo:400: 00000100:00100000:1.0:1787833714.430307:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f375c51e pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009088:0@lo:101: 00010000:00010000:1.0:1787833714.430321:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.430330:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833714.431382:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009216:0@lo:256: 00000100:00100000:1.0:1787833714.431454:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.431770:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000001daa183a going to sleep for 11 seconds 00000100:00080000:2.0:1787833714.437539:0:6519:0:(import.c:65:import_set_state_nolock()) 0000000011c31d25 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833714.437796:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070d55b5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874679406008832:12345-0@lo:38: Request processed in 8588us (9063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.437818:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833714.438080:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787833714.438091:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787833714.438100:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787833714.438105:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787833714.438108:0:3637:0:(import.c:65:import_set_state_nolock()) 0000000077fb2afd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787833714.438130:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000303186b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406008832:0@lo:38: 00000100:00100000:1.0:1787833714.438262:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000743604a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406009344:0@lo:41: 00000100:00100000:1.0:1787833714.438306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.438545:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406009344 00000100:00100000:2.0:1787833714.438552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406009344 00000100:00100000:2.0:1787833714.438684:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833714.438692:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000303186b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874679406009344:12345-0@lo:41: 00000004:00000024:2.0:1787833714.438723:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787833714.438796:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000303186b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874679406009344:12345-0@lo:41: Request processed in 106us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.438803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833714.438824:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406009216 00000100:00100000:2.0:1787833714.438828:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406009216 00000100:00100000:2.0:1787833714.438852:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787833714.438858:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a20f03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406009216:12345-0@lo:256: 20000000:01000000:2.0:1787833714.438895:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787833714.438912:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787833714.438916:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787833714.439154:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000743604a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406009344:0@lo:41: 00000100:00100000:2.0:1787833714.439691:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a20f03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406009216:12345-0@lo:256: Request processed in 831us (8236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.439710:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787833714.440106:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009216:0@lo:256: 10000000:01000000:1.0:1787833714.442146:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787833714.443251:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.443269:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833714.443290:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63b1db800 from 1 10000000:01000000:1.0:1787833714.443293:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833714.443334:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.443340:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.443350:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833714.443374:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009472:0@lo:101: 00000100:00100000:1.0:1787833714.443447:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.443484:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000001daa183a going to sleep for 11 seconds 00000100:00100000:0.0:1787833714.443710:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406009472 00000100:00100000:0.0:1787833714.443719:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406009472 00000100:00100000:0.0:1787833714.443798:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787833714.443806:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036f87914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:7443:x1874679406009472:12345-0@lo:101: 00010000:00010000:0.0:1787833714.443820:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833714.443832:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cf97 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.443856:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf97 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.443867:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf97 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.443876:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f4f908a, rc 0) 00000100:00100000:0.0:1787833714.443922:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036f87914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:7443:x1874679406009472:12345-0@lo:101: Request processed in 117us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.443939:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787833714.444838:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009472:0@lo:101: 00010000:00010000:1.0:1787833714.444860:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.444870:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833714.445010:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009600:0@lo:501: 00000100:00100000:1.0:1787833714.445060:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.445094:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000001daa183a going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.445275:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406009600 00000100:00100000:3.0:1787833714.445280:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406009600 00000100:00100000:3.0:1787833714.445319:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787833714.445327:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028174964 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:7443:x1874679406009600:12345-0@lo:501: 00000100:00100000:3.0:1787833714.445432:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028174964 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:7443:x1874679406009600:12345-0@lo:501: Request processed in 105us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.445439:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787833714.445511:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009600:0@lo:501: 00000100:00100000:1.0:1787833714.445539:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009728:0@lo:503: 00000100:00100000:1.0:1787833714.445732:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.445789:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000001daa183a going to sleep for 11 seconds 00000100:00100000:0.0:1787833714.445843:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406009728 00000100:00100000:0.0:1787833714.445848:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406009728 00000100:00100000:0.0:1787833714.445885:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787833714.445892:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003a0ffd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:7443:x1874679406009728:12345-0@lo:503: 00000040:00080000:0.0:1787833714.446056:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787833714.446097:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003a0ffd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:7443:x1874679406009728:12345-0@lo:503: Request processed in 205us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.446102:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787833714.446182:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009728:0@lo:503: 00000040:00080000:1.0:1787833714.446441:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833714.446554:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1787833714.446840:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833714.448283:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1787833714.448428:0:7443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787833714.448460:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833714.448566:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.448652:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833714.448710:0:7443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787833714.448713:0:7443:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df63b1db800 10000000:01000000:1.0:1787833714.448715:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df63b1db800 10000000:01000000:1.0:1787833714.448718:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787833714.448723:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df63b1db800 from 1 10000000:01000000:1.0:1787833714.448726:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787833714.449219:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 0000000004e2a8bb/0x996d2fb20dc1cfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.449229:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 0000000004e2a8bb/0x996d2fb20dc1cfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.449239:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 0000000004e2a8bb/0x996d2fb20dc1cfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833714.449261:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009856:0@lo:101: 00000100:00100000:1.0:1787833714.449339:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.449414:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063ff7775 going to sleep for 11 seconds 00000100:00100000:0.0:1787833714.449733:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406009856 00000100:00100000:0.0:1787833714.449741:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406009856 00000100:00100000:1.0:1787833714.450106:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787833714.450116:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d486f1db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:7443:x1874679406009856:12345-0@lo:101: 00010000:00010000:1.0:1787833714.450131:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833714.450146:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001fb53028/0x996d2fb20dc1cfac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cfa5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.450170:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001fb53028/0x996d2fb20dc1cfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfa5 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.450180:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001fb53028/0x996d2fb20dc1cfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfa5 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.450188:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001fb53028, rc 0) 00000100:00100000:1.0:1787833714.450247:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d486f1db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406009856:12345-0@lo:101: Request processed in 133us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833714.450253:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787833714.450332:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000325f4406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009856:0@lo:101: 00010000:00010000:2.0:1787833714.450347:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 0000000004e2a8bb/0x996d2fb20dc1cfa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.450355:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 0000000004e2a8bb/0x996d2fb20dc1cfa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833714.450468:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002235eb55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009984:0@lo:501: 00000100:00100000:2.0:1787833714.450509:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.450721:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000000713dfc7 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.450827:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406009984 00000100:00100000:3.0:1787833714.450832:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406009984 00000100:00100000:3.0:1787833714.450858:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787833714.450863:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f30e348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406009984:12345-0@lo:501: 00000100:00100000:3.0:1787833714.451030:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f30e348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406009984:12345-0@lo:501: Request processed in 166us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.451037:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787833714.451258:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002235eb55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406009984:0@lo:501: 00000100:00100000:2.0:1787833714.451288:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002235eb55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406010112:0@lo:503: 00000100:00100000:2.0:1787833714.451332:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.451391:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000000713dfc7 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.451434:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406010112 00000100:00100000:3.0:1787833714.451438:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406010112 00000100:00100000:3.0:1787833714.451580:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787833714.451588:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d0a0967 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406010112:12345-0@lo:503: 00000100:00100000:3.0:1787833714.451703:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d0a0967 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406010112:12345-0@lo:503: Request processed in 116us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.451710:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787833714.451798:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002235eb55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406010112:0@lo:503: 00000040:00080000:2.0:1787833714.452124:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787833714.452195:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002235eb55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406010240:0@lo:502: 00000100:00100000:2.0:1787833714.452230:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.452870:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000000713dfc7 going to sleep for 11 seconds 00000100:00100000:1.0:1787833714.453042:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406010240 00000100:00100000:1.0:1787833714.453050:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406010240 00000100:00100000:2.0:1787833714.453234:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787833714.453244:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024389c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406010240:12345-0@lo:502: 00000100:00100000:2.0:1787833714.453392:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024389c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406010240:12345-0@lo:502: Request processed in 150us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.453399:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787833714.453513:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002235eb55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406010240:0@lo:502: 00000040:00080000:3.0:1787833714.453940:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787833714.453972:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787833714.453985:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787833714.453998:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787833714.454010:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787833714.454038:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787833714.454053:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787833714.454065:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787833714.454078:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787833714.454089:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787833714.454102:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787833714.454115:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787833714.454127:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787833714.454140:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787833714.454153:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787833714.454166:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787833714.454178:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787833714.454191:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787833714.454202:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787833714.454213:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787833714.454225:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787833714.454252:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787833714.454267:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787833714.454280:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787833714.454292:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787833714.454315:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787833714.454327:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787833714.454338:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1787833714.454370:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406010368:0@lo:502: 00000100:00100000:3.0:1787833714.454424:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.455091:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b6b799ee going to sleep for 11 seconds 00000100:00100000:0.0:1787833714.455166:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406010368 00000100:00100000:0.0:1787833714.455174:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406010368 00000100:00100000:0.0:1787833714.455257:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833714.455264:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048be5e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406010368:12345-0@lo:502: 00000100:00100000:0.0:1787833714.455382:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048be5e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406010368:12345-0@lo:502: Request processed in 119us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.455389:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833714.455444:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406010368:0@lo:502: 00000040:00080000:0.0:1787833714.455518:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787833714.455527:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787833714.455856:0:7462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787833714.455870:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000cec0c0e3) 00000020:00000080:0.0:1787833714.455891:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787833714.456229:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000103928a5 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787833714.456233:0:7462:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000103928a5 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787833714.456236:0:7462:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000103928a5 3 00010000:00080000:0.0:1787833714.456272:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d4c47b84@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1787833714.457606:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833714.458804:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1787833714.459121:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787833714.459165:0:7462:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787833714.459201:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x996d2fb20dc1cfba 00000100:00080000:0.0:1787833714.459212:0:7462:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787833714.459218:0:7462:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000d4c47b84 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787833714.459260:0:7462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000012e6b685 x1874679406010496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787833714.459291:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787833714.459496:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406010496:0@lo:38: 00000100:00100000:1.0:1787833714.459566:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.461603:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406010496 00000100:00100000:0.0:1787833714.461616:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406010496 00000100:00100000:0.0:1787833714.461674:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833714.461681:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000325f4406 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406010496:12345-0@lo:38: 00010000:00080000:0.0:1787833714.461708:0:6513:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1787833714.461769:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x996d2fb20dc1cfc1 00000004:00100000:0.0:1787833714.461784:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787833714.461815:0:6513:0:(import.c:65:import_set_state_nolock()) 0000000094e12fc1 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787833714.461895:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000325f4406 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874679406010496:12345-0@lo:38: Request processed in 214us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.461902:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787833714.462645:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000012e6b685 x1874679406010496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833714.462659:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787833714.462667:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787833714.462674:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787833714.462679:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787833714.462681:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000d4c47b84 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787833714.462686:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406010496:0@lo:38: 00000040:00080000:0.0:1787833714.462826:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787833714.462879:0:7443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787833714.462908:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 40000000:00080000:1.0:1787833714.463063:0:7463:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00010000:00010000:0.0:1787833714.463222:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 0000000004e2a8bb/0x996d2fb20dc1cfa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.463233:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 0000000004e2a8bb/0x996d2fb20dc1cfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787833714.463298:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787833714.463300:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787833714.463302:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787833714.463303:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787833714.463304:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787833714.463306:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787833714.463307:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787833714.463308:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787833714.463310:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787833714.463311:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787833714.463313:0:7443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787833714.463316:0:7443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1787833714.463319:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787833714.463320:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787833714.463321:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787833714.463322:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787833714.463323:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787833714.463324:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787833714.463325:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787833714.463326:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787833714.463327:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787833714.463328:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787833714.463329:0:7443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787833714.463348:0:7443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787833714.463362:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406010624:0@lo:253: 00000100:00100000:0.0:1787833714.463422:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.464044:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b6b799ee going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.465087:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406010624 00000100:00100000:2.0:1787833714.465099:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406010624 00000100:00100000:1.0:1787833714.467456:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787833714.467482:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fe4d128 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7443:x1874679406010624:12345-0@lo:253: 20000000:01000000:1.0:1787833714.467513:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787833714.467525:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787833714.473243:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787833714.473368:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787833714.473398:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787833714.473542:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787833714.473547:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787833714.473569:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.473654:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cee1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.473661:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf82 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.473668:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.473702:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cf82 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.473717:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf82 expref: 15 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.473729:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406010752:0@lo:104: 00000100:00100000:3.0:1787833714.473886:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787833714.474011:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cee1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.474031:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cee1 expref: 15 pid: 6506 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.474040:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005aa3152e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406010880:0@lo:104: 00000100:00100000:3.0:1787833714.474064:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.474080:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set 000000000782b143 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.474145:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406010752 00000100:00100000:2.0:1787833714.474152:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406010752 00000100:00100000:2.0:1787833714.474185:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406010880 00000100:00100000:2.0:1787833714.474187:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406010880 00000100:00100000:2.0:1787833714.474200:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833714.474208:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c22acf6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6530:x1874679406010752:12345-0@lo:104: 00010000:00010000:2.0:1787833714.474219:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.474319:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d01cb8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406010752:0@lo:104: 00010000:00010000:2.0:1787833714.474722:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833714.474729:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c22acf6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6530:x1874679406010752:12345-0@lo:104: Request processed in 521us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.474737:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833714.474786:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787833714.474793:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069870552 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6530:x1874679406010880:12345-0@lo:104: 00010000:00010000:2.0:1787833714.474802:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.474851:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787833714.474855:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069870552 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6530:x1874679406010880:12345-0@lo:104: Request processed in 64us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.474860:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787833714.474876:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787833714.474881:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.474889:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000086cbbc79 already unused, calling callback (00000000945acc48) 10000000:00010000:2.0:1787833714.474901:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.474908:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833714.474914:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.475064:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005aa3152e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406010880:0@lo:104: 00010000:00010000:3.0:1787833714.475086:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833714.475127:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833714.475161:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.475168:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833714.475182:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.475188:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 0000000086cbbc79/0x996d2fb20dc1cf82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cf90 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.475200:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833714.475201:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.475206:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e0ca524 already unused, calling callback (00000000945acc48) 10000000:00010000:2.0:1787833714.475208:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.475214:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833714.475229:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833714.475233:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833714.475245:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.475250:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833714.475291:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833714.475302:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4bb802a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406011008:0@lo:103: 00000100:00100000:1.0:1787833714.475331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.475381:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406011008 00000100:00100000:1.0:1787833714.475385:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406011008 00010000:00010000:1.0:1787833714.475403:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf82 expref: 16 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.475745:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.475779:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 000000004e0ca524/0x996d2fb20dc1cee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cee8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.475796:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833714.475798:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833714.475799:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833714.475841:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833714.475851:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002235eb55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406011136:0@lo:103: 00000100:00100000:3.0:1787833714.475885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.476199:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fe4d128 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:7443:x1874679406010624:12345-0@lo:253: Request processed in 8731us (12776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.476207:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787833714.476551:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406011136 00000100:00100000:1.0:1787833714.476557:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406011136 00010000:00010000:1.0:1787833714.476585:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cee1 expref: 16 pid: 6506 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833714.476603:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833714.476628:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f20cac4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:3641:x1874679406011008:12345-0@lo:103: 00010000:00010000:1.0:1787833714.476640:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833714.476644:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf82 expref: 16 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476653:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf82 expref: 16 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476668:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001479d797/0x996d2fb20dc1cf90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cf82 expref: 16 pid: 6507 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476680:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833714.476715:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f20cac4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3641:x1874679406011008:12345-0@lo:103: Request processed in 107us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833714.476721:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833714.476771:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787833714.476778:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bbbbd6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:3639:x1874679406011136:12345-0@lo:103: 00010000:00010000:1.0:1787833714.476785:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833714.476788:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cee1 expref: 14 pid: 6506 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476795:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cee1 expref: 14 pid: 6506 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476804:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000867b3bb2/0x996d2fb20dc1cee8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cee1 expref: 14 pid: 6506 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476814:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476821:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787833714.476834:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003287406s 00010000:00010000:1.0:1787833714.476837:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476843:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476849:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476855:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476861:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009d2e7d86 already unused, calling callback (000000008ec170e8) 00010000:00010000:1.0:1787833714.476874:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476880:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476894:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.476904:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833714.477247:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4bb802a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406011008:0@lo:103: 00000100:00100000:1.0:1787833714.477319:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bbbbd6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:3639:x1874679406011136:12345-0@lo:103: Request processed in 542us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833714.477327:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787833714.477392:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.477400:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.477405:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009d2e7d86/0x996d2fb20dc1cfc8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.477458:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002235eb55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406011136:0@lo:103: 00000100:00100000:0.0:1787833714.483161:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:7443:1874679406010624:0@lo:253: 10000000:01000000:0.0:1787833714.483185:0:7443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787833714.483189:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787833714.483191:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787833714.483192:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787833714.483193:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787833714.483207:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787833714.483208:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787833714.483209:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787833714.483211:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787833714.483212:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787833714.483214:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787833714.483215:0:7443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787833714.483232:0:7443:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787833714.491874:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1787833714.492260:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787833714.492447:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787833714.493181:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787833714.493434:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787833714.495613:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787833714.496516:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787833714.497196:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787833714.497381:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1787833714.499179:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787833714.499429:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1787833714.502634:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1787833714.508804:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787833714.509221:0:7467:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787833714.509225:0:7467:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787833714.511401:0:7468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1787833714.511488:0:7468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005aa3152e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7468:1874679406011264:0@lo:700: 00000100:00100000:3.0:1787833714.511592:0:7468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.511657:0:7468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026fb8058 going to sleep for 11 seconds 00000100:00100000:1.0:1787833714.511718:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406011264 00000100:00100000:1.0:1787833714.511724:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406011264 00000100:00100000:1.0:1787833714.511809:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833714.511816:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058d01cb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7468:x1874679406011264:12345-0@lo:700: 00000040:01000000:1.0:1787833714.515337:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787833714.518256:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096a0cafc pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406011392:0@lo:1000: 00000100:00100000:1.0:1787833714.518332:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.518381:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb1e2f06 going to sleep for 11 seconds 00000100:00100000:0.0:1787833714.518431:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406011392 00000100:00100000:0.0:1787833714.518439:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406011392 00000100:00100000:0.0:1787833714.518499:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833714.518507:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f20cac4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406011392:12345-0@lo:1000: 00000100:00100000:0.0:1787833714.518593:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f20cac4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406011392:12345-0@lo:1000: Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.518599:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833714.518661:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096a0cafc pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406011392:0@lo:1000: 00000040:01000000:0.0:1787833714.518687:0:7469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787833714.518710:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406011520:0@lo:700: 00000100:00100000:0.0:1787833714.518734:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.520233:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000678ad94a going to sleep for 11 seconds 00000040:01000000:3.0:1787833714.520517:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787833714.523411:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787833714.523866:0:7443:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787833714.523879:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787833714.524071:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:0.0:1787833714.526300:0:6521:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1787833714.526785:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406011520 00000100:00100000:2.0:1787833714.526796:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406011520 00000100:00100000:2.0:1787833714.526844:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833714.526852:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b622b28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406011520:12345-0@lo:700: 00000100:00100000:2.0:1787833714.526970:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b622b28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406011520:12345-0@lo:700: Request processed in 119us (8235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.526977:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833714.527235:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406011520:0@lo:700: 00000100:00100000:1.0:1787833714.527305:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f341e331 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7469:1874679406011648:0@lo:900: 00000100:00100000:1.0:1787833714.527343:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.527378:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9c34d87 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.528316:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406011648 00000100:00100000:2.0:1787833714.528339:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406011648 00000100:00100000:2.0:1787833714.528381:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833714.528387:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d459efe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7469:x1874679406011648:12345-0@lo:900: 00000100:00100000:2.0:1787833714.528460:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d459efe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7469:x1874679406011648:12345-0@lo:900: Request processed in 74us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.528467:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787833714.528555:0:7469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f341e331 x1874679406011648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787833730 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833714.528566:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f341e331 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7469:1874679406011648:0@lo:900: 00000100:00100000:1.0:1787833714.528673:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f341e331 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406011776:0@lo:1000: 00000100:00100000:1.0:1787833714.528704:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.528737:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 000000006243dea8 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.529063:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406011776 00000100:00100000:2.0:1787833714.529068:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406011776 00000100:00100000:2.0:1787833714.529100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833714.529105:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b19474 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406011776:12345-0@lo:1000: 00000100:00100000:2.0:1787833714.529170:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b19474 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406011776:12345-0@lo:1000: Request processed in 65us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.529176:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833714.529205:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f341e331 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406011776:0@lo:1000: 00000004:00080000:2.0:1787833714.529242:0:7469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f9c34d87 with version 0 00000020:00100000:2.0:1787833714.529256:0:7469:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787833714.529260:0:7469:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000743604a5 x1874679406012032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787833714.529271:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000743604a5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406012032:0@lo:1000: 00000100:00100000:2.0:1787833714.529296:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.529313:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406012032 00000100:00100000:2.0:1787833714.529316:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406012032 00000100:00100000:2.0:1787833714.529331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833714.529336:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e01de32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406012032:12345-0@lo:1000: 00000100:00100000:2.0:1787833714.529683:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000377ec042 going to sleep for 11 seconds 00000040:00080000:3.0:1787833714.532009:0:7443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787833714.532618:0:7443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787833714.532665:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787833714.532945:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787833714.533174:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787833714.533802:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787833714.533964:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787833714.534111:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787833714.534252:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787833714.534391:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787833714.534609:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000001:00080000:1.0:1787833714.538882:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1787833714.539190:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e01de32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406012032:12345-0@lo:1000: Request processed in 9849us (9889us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787833714.539217:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1787833714.539315:0:7469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787833714.539321:0:7469:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787833714.539336:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000743604a5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406012032:0@lo:1000: 00000100:00100000:1.0:1787833714.539422:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000097c6795 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406012160:0@lo:1000: 00000100:00100000:1.0:1787833714.539458:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.539514:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd2fed13 going to sleep for 11 seconds 00000100:00100000:2.0:1787833714.539667:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406012160 00000100:00100000:2.0:1787833714.539674:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406012160 00000100:00100000:2.0:1787833714.539712:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787833714.539719:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000651b6884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406012160:12345-0@lo:1000: 00000100:00100000:2.0:1787833714.539825:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000651b6884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7469:x1874679406012160:12345-0@lo:1000: Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.539832:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787833714.539916:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000097c6795 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1874679406012160:0@lo:1000: 00000040:00080000:1.0:1787833714.540068:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787833714.540100:0:7469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f9c34d87 with version 1 00000100:00100000:0.0:1787833714.542213:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058d01cb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7468:x1874679406011264:12345-0@lo:700: Request processed in 30390us (30613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.542235:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787833714.542453:0:7468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005aa3152e x1874679406011264/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787833730 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833714.542470:0:7468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005aa3152e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7468:1874679406011264:0@lo:700: 40000000:02000000:2.0:1787833714.542483:0:7468:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:3.0:1787833714.543715:0:7459:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000de8fe70b version 1 rpc_version 1 00000020:00100000:3.0:1787833714.543768:0:7459:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787833714.543776:0:7459:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e1d91c7b x1874679406012416/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833714.543797:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1d91c7b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1874679406012416:0@lo:1000: 00000100:00100000:3.0:1787833714.543859:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.543910:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098c435d3 going to sleep for 11 seconds 00100000:10000000:3.0:1787833714.544277:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787833714.544441:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787833714.544879:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787833714.545224:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787833714.545365:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787833714.545503:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:0.0:1787833714.546049:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406012416 00000100:00100000:0.0:1787833714.546059:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406012416 00000100:00100000:0.0:1787833714.546103:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833714.546111:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f261717 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874679406012416:12345-0@lo:1000: 00000040:00080000:1.0:1787833714.546304:0:7469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787833714.546374:0:7469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:3.0:1787833714.546843:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787833714.551468:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787833714.551656:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787833714.551817:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787833714.556535:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787833714.560124:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787833714.560311:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787833714.560461:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787833714.560619:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787833714.560784:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787833714.560930:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787833714.561097:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787833714.561224:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787833714.561356:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787833714.561481:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787833714.561634:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787833714.561815:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787833714.561949:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787833714.562084:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787833714.562231:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787833714.562466:0:7443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1787833714.568261:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1787833714.568401:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f261717 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874679406012416:12345-0@lo:1000: Request processed in 22288us (24539us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787833714.568414:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787833714.571436:0:7459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787833714.571462:0:7459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787833714.571498:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1d91c7b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1874679406012416:0@lo:1000: 00000001:00080000:1.0:1787833714.577376:0:7443:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787833714.577430:0:7443:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9fc9c1c43988 00100000:10000000:1.0:1787833714.577438:0:7443:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787833714.578026:0:7443:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787833714.578060:0:7443:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787833714.578083:0:7443:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787833714.578101:0:7443:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787833714.579082:0:7443:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787833714.579268:0:7443:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1787833714.606804:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787833714.634897:0:7468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787833714.634974:0:7468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787833714.634979:0:7468:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1787833715.478202:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833716.503578:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833717.539269:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833718.551682:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833719.573971:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833719.638191:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406012544:0@lo:400: 00000100:00100000:2.0:1787833719.638273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833719.638333:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833719.638339:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007c14aff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406012928:0@lo:400: 00000100:00100000:2.0:1787833719.638366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833719.638403:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008347bec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406012672:0@lo:400: 00000100:00100000:2.0:1787833719.638428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833719.638446:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833719.638451:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002dabde7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406012800:0@lo:400: 00000100:00100000:2.0:1787833719.638490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833719.638544:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406012544 00000100:00100000:2.0:1787833719.638553:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406012544 00000100:00100000:2.0:1787833719.638851:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787833719.638862:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f11868e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:3639:x1874679406012544:12345-0@lo:400: 00000100:00100000:2.0:1787833719.638924:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f11868e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:3639:x1874679406012544:12345-0@lo:400: Request processed in 65us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833719.638931:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787833719.638965:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406012928 00000100:00100000:2.0:1787833719.638970:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406012928 00000100:00100000:2.0:1787833719.639081:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406012672 00000100:00100000:2.0:1787833719.639085:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406012672 00000100:00100000:2.0:1787833719.639099:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833719.639106:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043a9b42f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406012928:12345-0@lo:400: 00000100:00100000:2.0:1787833719.639138:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043a9b42f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406012928:12345-0@lo:400: Request processed in 33us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833719.639143:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833719.639154:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787833719.639158:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000743604a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406012672:12345-0@lo:400: 00000100:00100000:2.0:1787833719.639188:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000743604a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406012672:12345-0@lo:400: Request processed in 29us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833719.639193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787833719.639214:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406012800 00000100:00100000:2.0:1787833719.639217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406012800 00000100:00100000:2.0:1787833719.639240:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833719.639245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002235eb55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406012800:12345-0@lo:400: 00000100:00100000:2.0:1787833719.639280:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002235eb55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406012800:12345-0@lo:400: Request processed in 35us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833719.639294:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833719.639340:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002dabde7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406012800:0@lo:400: 00010000:00080000:2.0:1787833719.639352:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008347bec7 x1874679406012672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833719.639361:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008347bec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406012672:0@lo:400: 00010000:00080000:3.0:1787833719.639445:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000007c14aff x1874679406012928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833719.639454:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007c14aff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406012928:0@lo:400: 00000100:00100000:3.0:1787833719.639462:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406012544:0@lo:400: 00000100:00100000:3.0:1787833719.639882:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008347bec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406013056:0@lo:41: 00000100:00100000:3.0:1787833719.639916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833719.640061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406013056 00000100:00100000:1.0:1787833719.640066:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406013056 00000100:00100000:1.0:1787833719.640096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787833719.640101:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000804589c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406013056:12345-0@lo:41: 00000004:00000024:1.0:1787833719.640125:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787833719.651846:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000804589c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406013056:12345-0@lo:41: Request processed in 11733us (11917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833719.651864:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787833719.654359:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008347bec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406013056:0@lo:41: 00010000:00010000:3.0:1787833720.601490:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787833720.776322:0:7714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787833721.623493:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787833722.092582:0:7767:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787833722.093125:0:7767:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787833722.647006:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787833723.221943:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787833723.221951:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df63b1db800 from 4 10000000:01000000:3.0:1787833723.221956:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787833723.221997:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 000000001ae69cfd/0x996d2fb20dc1cfcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.222008:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 000000001ae69cfd/0x996d2fb20dc1cfcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.222016:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 000000001ae69cfd/0x996d2fb20dc1cfcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833723.222038:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013184:0@lo:101: 00000100:00100000:3.0:1787833723.222111:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833723.222250:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406013184 00000100:00100000:2.0:1787833723.222258:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406013184 00000100:00100000:2.0:1787833723.222306:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787833723.222314:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9476233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:6511:x1874679406013184:12345-0@lo:101: 00010000:00010000:2.0:1787833723.222328:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833723.222341:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f8463cba/0x996d2fb20dc1cfd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cfcf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.222362:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f8463cba/0x996d2fb20dc1cfd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfcf expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.222372:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f8463cba/0x996d2fb20dc1cfd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfcf expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.222380:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f8463cba, rc 0) 00000100:00100000:2.0:1787833723.222426:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9476233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:6511:x1874679406013184:12345-0@lo:101: Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.222432:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787833723.222960:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d71a6c1b going to sleep for 11 seconds 00000100:00100000:3.0:1787833723.222988:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013184:0@lo:101: 00010000:00010000:3.0:1787833723.223002:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 000000001ae69cfd/0x996d2fb20dc1cfcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.223009:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 000000001ae69cfd/0x996d2fb20dc1cfcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833723.223056:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013312:0@lo:256: 00000100:00100000:3.0:1787833723.223089:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833723.223358:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406013312 00000100:00100000:2.0:1787833723.223363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406013312 00000100:00100000:2.0:1787833723.223400:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787833723.223405:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf0d24b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:6511:x1874679406013312:12345-0@lo:256: 20000000:01000000:2.0:1787833723.223428:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787833723.223441:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787833723.223444:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787833723.223510:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf0d24b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:6511:x1874679406013312:12345-0@lo:256: Request processed in 105us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.223517:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787833723.226177:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d71a6c1b going to sleep for 11 seconds 00000100:00100000:3.0:1787833723.226224:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013312:0@lo:256: 10000000:01000000:3.0:1787833723.226297:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787833723.226307:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 000000001ae69cfd/0x996d2fb20dc1cfcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.226317:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 000000001ae69cfd/0x996d2fb20dc1cfcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833723.226327:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787833723.226329:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df60efc3000 from 21 10000000:01000000:3.0:1787833723.226332:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787833723.226367:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000570696e4/0x996d2fb20dc1cfdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.226374:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000570696e4/0x996d2fb20dc1cfdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.226382:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000570696e4/0x996d2fb20dc1cfdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833723.226488:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013440:0@lo:101: 00000100:00100000:3.0:1787833723.226550:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833723.226642:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d71a6c1b going to sleep for 11 seconds 00000100:00100000:2.0:1787833723.229141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406013440 00000100:00100000:2.0:1787833723.229155:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406013440 00000100:00100000:2.0:1787833723.229277:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787833723.229287:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077be78d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:6511:x1874679406013440:12345-0@lo:101: 00010000:00010000:2.0:1787833723.229303:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833723.229321:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1cfe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cfdd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.229345:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1cfe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfdd expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.229354:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e0ca524/0x996d2fb20dc1cfe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfdd expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.229361:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e0ca524, rc 0) 00000100:00100000:2.0:1787833723.229445:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077be78d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406013440:12345-0@lo:101: Request processed in 160us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.229452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787833723.229537:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013440:0@lo:101: 00010000:00010000:3.0:1787833723.229554:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000570696e4/0x996d2fb20dc1cfdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.229570:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000570696e4/0x996d2fb20dc1cfdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833723.229641:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013568:0@lo:501: 00000100:00100000:3.0:1787833723.229690:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833723.235155:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d71a6c1b going to sleep for 11 seconds 00000100:00100000:1.0:1787833723.236208:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406013568 00000100:00100000:1.0:1787833723.236221:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406013568 00000100:00100000:1.0:1787833723.236278:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787833723.236287:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc7cc205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406013568:12345-0@lo:501: 00000100:00100000:1.0:1787833723.236475:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc7cc205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406013568:12345-0@lo:501: Request processed in 188us (6784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833723.236482:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787833723.236659:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013568:0@lo:501: 00000100:00100000:3.0:1787833723.236713:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013696:0@lo:503: 00000100:00100000:3.0:1787833723.236803:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833723.236835:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d71a6c1b going to sleep for 11 seconds 00000100:00100000:1.0:1787833723.236916:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406013696 00000100:00100000:1.0:1787833723.236921:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406013696 00000100:00100000:1.0:1787833723.236941:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787833723.236947:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c68db746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406013696:12345-0@lo:503: 00000100:00100000:1.0:1787833723.237041:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c68db746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406013696:12345-0@lo:503: Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833723.237048:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787833723.237176:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406013696:0@lo:503: 00000100:00100000:3.0:1787833723.237719:0:7819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:7819:1874679406013824:0@lo:502: 00000100:00100000:3.0:1787833723.237789:0:7819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833723.237819:0:7819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000515049b4 going to sleep for 11 seconds 00000100:00100000:1.0:1787833723.237848:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406013824 00000100:00100000:1.0:1787833723.237854:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406013824 00000100:00100000:1.0:1787833723.237903:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787833723.237911:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c154f1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7819:x1874679406013824:12345-0@lo:502: 00000100:00100000:1.0:1787833723.238024:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c154f1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7819:x1874679406013824:12345-0@lo:502: Request processed in 114us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833723.238032:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787833723.238141:0:7819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:7819:1874679406013824:0@lo:502: 00000100:00100000:3.0:1787833723.238183:0:7819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:7819:1874679406013952:0@lo:502: 00000100:00100000:3.0:1787833723.238222:0:7819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833723.238242:0:7819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000515049b4 going to sleep for 11 seconds 00000100:00100000:0.0:1787833723.238497:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406013952 00000100:00100000:0.0:1787833723.238502:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406013952 00000100:00100000:0.0:1787833723.238598:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787833723.238607:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb802c02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7819:x1874679406013952:12345-0@lo:502: 00000100:00100000:0.0:1787833723.238772:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb802c02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:7819:x1874679406013952:12345-0@lo:502: Request processed in 166us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.238780:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787833723.243600:0:7819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:7819:1874679406013952:0@lo:502: 00000040:00080000:3.0:1787833723.243843:0:7819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787833723.247403:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787833723.247444:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787833723.247454:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000570696e4/0x996d2fb20dc1cfdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833723.247467:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000570696e4/0x996d2fb20dc1cfdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833723.247479:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787833723.247481:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60efc3000 from 4 10000000:01000000:1.0:1787833723.247485:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787833723.247524:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 000000007dc8cb5e/0x996d2fb20dc1cfeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833723.247543:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 000000007dc8cb5e/0x996d2fb20dc1cfeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833723.247552:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 000000007dc8cb5e/0x996d2fb20dc1cfeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833723.247610:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014080:0@lo:101: 00000100:00100000:1.0:1787833723.247681:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833723.248679:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd3f5079 going to sleep for 11 seconds 00000100:00100000:2.0:1787833723.250813:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406014080 00000100:00100000:2.0:1787833723.250842:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406014080 00000100:00100000:2.0:1787833723.250953:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787833723.250962:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007660c489 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406014080:12345-0@lo:101: 00010000:00010000:2.0:1787833723.250978:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833723.251012:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008fdd4d4b/0x996d2fb20dc1cff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cfeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.251037:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008fdd4d4b/0x996d2fb20dc1cff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfeb expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.251046:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008fdd4d4b/0x996d2fb20dc1cff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfeb expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.251055:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008fdd4d4b, rc 0) 00000100:00100000:2.0:1787833723.251137:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007660c489 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406014080:12345-0@lo:101: Request processed in 176us (3455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.251143:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787833723.251232:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014080:0@lo:101: 00010000:00010000:1.0:1787833723.251250:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 000000007dc8cb5e/0x996d2fb20dc1cfeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833723.251258:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 000000007dc8cb5e/0x996d2fb20dc1cfeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833723.251310:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014208:0@lo:256: 00000100:00100000:1.0:1787833723.251344:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833723.253701:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd3f5079 going to sleep for 11 seconds 00000100:00100000:0.0:1787833723.254932:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406014208 00000100:00100000:0.0:1787833723.254945:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406014208 00000100:00100000:0.0:1787833723.255079:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787833723.255088:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000892a7114 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406014208:12345-0@lo:256: 20000000:01000000:0.0:1787833723.255113:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787833723.255147:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787833723.255150:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787833723.255734:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000892a7114 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406014208:12345-0@lo:256: Request processed in 647us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.255744:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787833723.255958:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014208:0@lo:256: 10000000:01000000:1.0:1787833723.256014:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787833723.256023:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 000000007dc8cb5e/0x996d2fb20dc1cfeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833723.256033:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 000000007dc8cb5e/0x996d2fb20dc1cfeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833723.256041:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787833723.256043:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787833723.256046:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787833723.256073:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 0000000038529129/0x996d2fb20dc1cff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833723.256091:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 0000000038529129/0x996d2fb20dc1cff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833723.256100:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 0000000038529129/0x996d2fb20dc1cff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833723.256117:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014336:0@lo:101: 00000100:00100000:1.0:1787833723.256153:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833723.256181:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd3f5079 going to sleep for 11 seconds 00000100:00100000:0.0:1787833723.256328:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406014336 00000100:00100000:0.0:1787833723.256340:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406014336 00000100:00100000:0.0:1787833723.256367:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787833723.256372:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c9cb150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406014336:12345-0@lo:101: 00010000:00010000:0.0:1787833723.256383:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833723.256394:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000896f1ed7/0x996d2fb20dc1d000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1cff9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833723.256427:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000896f1ed7/0x996d2fb20dc1d000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1cff9 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833723.256438:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000896f1ed7/0x996d2fb20dc1d000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cff9 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833723.256446:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000896f1ed7, rc 0) 00000100:00100000:0.0:1787833723.256485:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c9cb150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406014336:12345-0@lo:101: Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.256491:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787833723.260231:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014336:0@lo:101: 00010000:00010000:1.0:1787833723.260262:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 0000000038529129/0x996d2fb20dc1cff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833723.260273:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 0000000038529129/0x996d2fb20dc1cff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833723.260353:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014464:0@lo:501: 00000100:00100000:1.0:1787833723.260413:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833723.260455:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd3f5079 going to sleep for 11 seconds 00000100:00100000:0.0:1787833723.260556:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406014464 00000100:00100000:0.0:1787833723.260571:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406014464 00000100:00100000:0.0:1787833723.260621:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787833723.260633:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ccedcf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406014464:12345-0@lo:501: 00000100:00100000:0.0:1787833723.260885:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ccedcf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406014464:12345-0@lo:501: Request processed in 253us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.260893:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787833723.261050:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014464:0@lo:501: 00000100:00100000:1.0:1787833723.261081:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014592:0@lo:503: 00000100:00100000:1.0:1787833723.261129:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833723.261192:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd3f5079 going to sleep for 11 seconds 00000100:00100000:3.0:1787833723.261225:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406014592 00000100:00100000:3.0:1787833723.261230:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406014592 00000100:00100000:3.0:1787833723.261360:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787833723.261368:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090e13171 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406014592:12345-0@lo:503: 00000100:00100000:3.0:1787833723.261496:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090e13171 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406014592:12345-0@lo:503: Request processed in 130us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833723.261504:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787833723.261646:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406014592:0@lo:503: 00000100:00100000:1.0:1787833723.262023:0:7820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:7820:1874679406014720:0@lo:502: 00000100:00100000:1.0:1787833723.262068:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833723.262097:0:7820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d21a1b1b going to sleep for 11 seconds 00000100:00100000:0.0:1787833723.262146:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406014720 00000100:00100000:0.0:1787833723.262152:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406014720 00000100:00100000:0.0:1787833723.262185:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787833723.262191:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096fbf371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:7820:x1874679406014720:12345-0@lo:502: 00000100:00100000:1.0:1787833723.262400:0:7820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce4d865 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:7820:1874679406014720:0@lo:502: 00000020:01000000:1.0:1787833723.262422:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833723.262431:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833723.262434:0:7820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787833723.262438:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787833723.262441:0:7820:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:00000080:1.0:1787833723.262701:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787833723.262725:0:7820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000014a4c845) 00000020:00000080:1.0:1787833723.262745:0:7820:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1787833723.262846:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787833723.262921:0:7820:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787833723.262927:0:7820:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787833723.262933:0:7820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1d00e 00010000:00080000:1.0:1787833723.262962:0:7820:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000700267ec@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.117@tcp at head 00000100:00100000:0.0:1787833723.263377:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096fbf371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:7820:x1874679406014720:12345-0@lo:502: Request processed in 1183us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.263391:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:1.0:1787833723.265403:0:7820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1787833723.266453:0:7820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787833723.266465:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787833723.266497:0:7820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787833723.266651:0:7820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1d015 00000100:00080000:0.0:1787833723.266663:0:7820:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787833723.266668:0:7820:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000700267ec using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787833723.266701:0:7820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000012e6b685 x1874679406014848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787833723.266791:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406014848:0@lo:38: 00000100:00100000:1.0:1787833723.266875:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833723.266966:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406014848 00000100:00100000:2.0:1787833723.266973:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406014848 00000100:00100000:2.0:1787833723.267007:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787833723.267013:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ce4d865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406014848:12345-0@lo:38: 00010000:00080000:2.0:1787833723.267036:0:6519:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1787833723.267066:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1d01c 00000004:00100000:2.0:1787833723.267080:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787833723.267085:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787833723.267213:0:7820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1787833723.267256:0:7820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787833723.267404:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4bb802a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406014976:0@lo:400: 00000100:00100000:2.0:1787833723.267438:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833723.267461:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833723.267476:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008347bec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406015104:0@lo:400: 00000100:00100000:2.0:1787833723.267525:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833723.267555:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406015232:0@lo:400: 00000100:00100000:2.0:1787833723.267588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833723.267622:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406014976 00000100:00100000:2.0:1787833723.267626:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406014976 00000100:00100000:2.0:1787833723.267654:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406015232 00000100:00100000:2.0:1787833723.267657:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406015232 00000100:00100000:2.0:1787833723.267671:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787833723.267676:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007c14aff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406014976:12345-0@lo:400: 00000100:00100000:2.0:1787833723.267722:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007c14aff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406014976:12345-0@lo:400: Request processed in 46us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.267729:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787833723.267745:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833723.267768:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c5bb343 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406015232:12345-0@lo:400: 00000100:00100000:2.0:1787833723.267800:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c5bb343 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406015232:12345-0@lo:400: Request processed in 50us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.267806:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833723.267829:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787833723.267835:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:2.0:1787833723.267947:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007e01ecfb x1874679406015232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833723.267960:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e01ecfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406015232:0@lo:400: 00010000:00080000:2.0:1787833723.267988:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b4bb802a x1874679406014976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833723.267997:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4bb802a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406014976:0@lo:400: 00000100:00100000:2.0:1787833723.268038:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406015104 00000100:00100000:2.0:1787833723.268041:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406015104 00000100:00100000:2.0:1787833723.268122:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833723.268128:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf3477e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406015104:12345-0@lo:400: 00000100:00100000:2.0:1787833723.268166:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf3477e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406015104:12345-0@lo:400: Request processed in 38us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.268172:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833723.268193:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008347bec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406015104:0@lo:400: 00000100:00080000:3.0:1787833723.274398:0:7824:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000009b5d8742 x1874679406015360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833723.274415:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068180f95 going to sleep for 0 seconds 00000020:01000000:0.0:1787833723.274581:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833723.274650:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833723.274652:0:7820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787833723.274656:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833723.274723:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833723.274725:0:7820:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787833723.274729:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787833723.274731:0:7820:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787833723.274984:0:7820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd8f39cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:7820:1874679406015488:0@lo:502: 00000100:00100000:0.0:1787833723.275069:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833723.275204:0:7820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031213503 going to sleep for 11 seconds 00000100:00100000:2.0:1787833723.275242:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406015488 00000100:00100000:2.0:1787833723.281417:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406015488 00000100:00100000:2.0:1787833723.281505:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787833723.281515:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7033fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:7820:x1874679406015488:12345-0@lo:502: 00000100:00100000:2.0:1787833723.281722:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7033fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:7820:x1874679406015488:12345-0@lo:502: Request processed in 209us (6653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.281731:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787833723.281918:0:7820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd8f39cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:7820:1874679406015488:0@lo:502: 00000020:01000000:1.0:1787833723.282098:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833723.282106:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833723.282109:0:7820:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787833723.282114:0:7820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:2.0:1787833723.284168:0:6519:0:(import.c:65:import_set_state_nolock()) 000000005a825b50 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833723.284263:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ce4d865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874679406014848:12345-0@lo:38: Request processed in 17248us (17387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.284304:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787833723.284313:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787833723.284322:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787833723.284326:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787833723.284329:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000700267ec lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787833723.284340:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787833723.284392:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000068180f95): req@000000009b5d8742 x1874679406015360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833723.284436:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406014848:0@lo:38: 00000100:00100000:2.0:1787833723.284579:0:7824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833723.284614:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068180f95 going to sleep for 11 seconds 00000100:00100000:0.0:1787833723.284825:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406015360 00000100:00100000:0.0:1787833723.284832:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406015360 00000100:00100000:0.0:1787833723.284869:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787833723.284876:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079b71046 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7824:x1874679406015360:12345-0@lo:1000: 00000100:00100000:0.0:1787833723.284947:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079b71046 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7824:x1874679406015360:12345-0@lo:1000: Request processed in 72us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.284955:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787833723.284985:0:7824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b5d8742 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406015360:0@lo:1000: 00000040:01000000:0.0:1787833723.285018:0:7824:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787833723.285054:0:7824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406015616:0@lo:1000: 00000100:00100000:0.0:1787833723.285084:0:7824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833723.285106:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406015616 00000100:00100000:0.0:1787833723.285110:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406015616 00000100:00100000:0.0:1787833723.285132:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787833723.285138:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f375c51e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7824:x1874679406015616:12345-0@lo:1000: 00000100:00100000:0.0:1787833723.285233:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f375c51e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7824:x1874679406015616:12345-0@lo:1000: Request processed in 95us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.285239:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787833723.285256:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000249bc651 going to sleep for 11 seconds 00000100:00100000:0.0:1787833723.285267:0:7824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406015616:0@lo:1000: 00000100:00100000:0.0:1787833723.285299:0:7824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406015744:0@lo:700: 00000100:00100000:0.0:1787833723.285323:0:7824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833723.285349:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406015744 00000100:00100000:0.0:1787833723.285353:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406015744 00000100:00100000:0.0:1787833723.285385:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833723.285391:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000331bd848 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7824:x1874679406015744:12345-0@lo:700: 00000100:00100000:0.0:1787833723.285437:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000331bd848 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7824:x1874679406015744:12345-0@lo:700: Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.285443:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833723.285461:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000665c50b2 going to sleep for 11 seconds 00000100:00100000:0.0:1787833723.285473:0:7824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406015744:0@lo:700: 00000100:00100000:0.0:1787833723.285635:0:7824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406015872:0@lo:1000: 00000020:01000000:3.0:1787833723.287072:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787833723.287107:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787833723.287117:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 0000000038529129/0x996d2fb20dc1cff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.287130:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 0000000038529129/0x996d2fb20dc1cff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833723.287148:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787833723.287151:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df60ec73490 from 1 10000000:01000000:3.0:1787833723.287154:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787833723.287187:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 000000001cdb88aa/0x996d2fb20dc1d023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.287220:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 000000001cdb88aa/0x996d2fb20dc1d023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833723.287229:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 000000001cdb88aa/0x996d2fb20dc1d023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833723.287244:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c96568 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406016000:0@lo:101: 00000100:00100000:3.0:1787833723.287297:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833723.287332:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d511707 going to sleep for 11 seconds 00000100:00100000:2.0:1787833723.287524:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406016000 00000100:00100000:2.0:1787833723.287531:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406016000 00000100:00100000:2.0:1787833723.287590:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787833723.287597:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c8d3865 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406016000:12345-0@lo:101: 00010000:00010000:2.0:1787833723.287609:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833723.287621:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f9f5508/0x996d2fb20dc1d02a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d023 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.287650:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f9f5508/0x996d2fb20dc1d02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d023 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.287805:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f9f5508/0x996d2fb20dc1d02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d023 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.287815:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f9f5508, rc 0) 00000100:00100000:2.0:1787833723.287856:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c8d3865 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406016000:12345-0@lo:101: Request processed in 260us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.287862:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787833723.287904:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c96568 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406016000:0@lo:101: 00010000:00010000:2.0:1787833723.287917:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 000000001cdb88aa/0x996d2fb20dc1d023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.287925:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 000000001cdb88aa/0x996d2fb20dc1d023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833723.287998:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c34922c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406016128:0@lo:501: 00000100:00100000:2.0:1787833723.288027:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833723.288042:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406016128 00000100:00100000:2.0:1787833723.288045:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e145044 going to sleep for 11 seconds 00000100:00100000:3.0:1787833723.288046:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406016128 00000100:00100000:3.0:1787833723.288067:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787833723.288073:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fc216cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406016128:12345-0@lo:501: 00000100:00100000:3.0:1787833723.288500:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fc216cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406016128:12345-0@lo:501: Request processed in 426us (472us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787833723.288508:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787833723.288611:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c34922c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406016128:0@lo:501: 10000000:01000000:2.0:1787833723.288639:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787833723.288644:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 000000001cdb88aa/0x996d2fb20dc1d023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833723.288651:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 000000001cdb88aa/0x996d2fb20dc1d023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833723.291412:0:7824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833723.291457:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 000000006851871c going to sleep for 11 seconds 00000100:00100000:2.0:1787833723.292733:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406015872 00000100:00100000:2.0:1787833723.292746:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406015872 00000100:00100000:2.0:1787833723.292839:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833723.292850:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8dee329 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7824:x1874679406015872:12345-0@lo:1000: 00000100:00100000:2.0:1787833723.292981:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8dee329 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7824:x1874679406015872:12345-0@lo:1000: Request processed in 132us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.292989:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787833723.293590:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833723.293687:0:7824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406015872:0@lo:1000: 00000004:00080000:0.0:1787833723.293789:0:7824:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000665c50b2 with version 0 00000020:00100000:0.0:1787833723.293808:0:7824:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787833723.293815:0:7824:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000012e6b685 x1874679406016512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787833723.293833:0:7824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406016512:0@lo:1000: 00000100:00100000:0.0:1787833723.293879:0:7824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833723.293905:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6d92d09 going to sleep for 11 seconds 00000100:00100000:1.0:1787833723.294013:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406016512 00000100:00100000:1.0:1787833723.294020:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406016512 00000100:00100000:1.0:1787833723.294062:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833723.294069:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8f39cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7824:x1874679406016512:12345-0@lo:1000: 00000100:00100000:2.0:1787833723.299159:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b8e7abc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406016256:0@lo:41: 00000100:00100000:2.0:1787833723.299237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833723.299374:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406016256 00000100:00100000:0.0:1787833723.299393:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406016256 00000100:00100000:0.0:1787833723.299465:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787833723.299474:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c34922c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3638:x1874679406016256:12345-0@lo:41: 00000004:00000024:0.0:1787833723.299508:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787833723.299585:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c34922c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3638:x1874679406016256:12345-0@lo:41: Request processed in 113us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833723.299592:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787833723.299837:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b8e7abc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406016256:0@lo:41: 00000001:00080000:0.0:1787833723.299973:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1787833723.299986:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787833723.302308:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8f39cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7824:x1874679406016512:12345-0@lo:1000: Request processed in 8234us (8423us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787833723.302340:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1787833723.302387:0:7824:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1787833723.302393:0:7824:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787833723.302509:0:7824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406016512:0@lo:1000: 00000100:00100000:0.0:1787833723.302672:0:7824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406016640:0@lo:1000: 00000100:00100000:0.0:1787833723.302717:0:7824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833723.302839:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000249bc651 going to sleep for 11 seconds 00000100:00100000:2.0:1787833723.302878:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406016640 00000100:00100000:2.0:1787833723.302886:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406016640 00000100:00100000:2.0:1787833723.302991:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787833723.303000:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ea14cdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7824:x1874679406016640:12345-0@lo:1000: 00000100:00100000:2.0:1787833723.303125:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ea14cdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7824:x1874679406016640:12345-0@lo:1000: Request processed in 126us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833723.303132:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787833723.303252:0:7824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7824:1874679406016640:0@lo:1000: 00000040:00080000:0.0:1787833723.303339:0:7824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787833723.303370:0:7824:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000665c50b2 with version 1 00000004:00080000:3.0:1787833723.304205:0:7821:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ba80524a version 1 rpc_version 1 00000020:00100000:3.0:1787833723.304232:0:7821:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787833723.304240:0:7821:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000dcc103e x1874679406016896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833723.304257:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dcc103e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7821:1874679406016896:0@lo:1000: 00000100:00100000:3.0:1787833723.304320:0:7821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833723.304355:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set 0000000080265120 going to sleep for 11 seconds 00000100:00100000:1.0:1787833723.304438:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406016896 00000100:00100000:1.0:1787833723.304445:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406016896 00000100:00100000:1.0:1787833723.304494:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787833723.304501:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053c96568 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7821:x1874679406016896:12345-0@lo:1000: 00000001:00080000:1.0:1787833723.309329:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1787833723.309552:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053c96568 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7821:x1874679406016896:12345-0@lo:1000: Request processed in 5047us (5227us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787833723.309588:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1787833723.309646:0:7821:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787833723.309652:0:7821:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787833723.309669:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dcc103e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7821:1874679406016896:0@lo:1000: 00000040:00080000:0.0:1787833723.309845:0:7824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787833723.310034:0:7824:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787833723.310039:0:7824:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787833723.670379:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833724.706277:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833724.758026:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084ab6ee2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406017024:0@lo:41: 00000100:00100000:1.0:1787833724.758130:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833724.758358:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406017024 00000100:00100000:0.0:1787833724.758366:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406017024 00000100:00100000:0.0:1787833724.758428:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787833724.758436:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000097c6795 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406017024:12345-0@lo:41: 00000004:00000024:0.0:1787833724.758472:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787833724.758528:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000097c6795 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406017024:12345-0@lo:41: Request processed in 93us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833724.758535:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787833724.758660:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084ab6ee2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406017024:0@lo:41: 00000020:00000004:0.0:1787833725.320472:0:7874:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787833725.321631:0:7874:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787833725.717976:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787833726.613425:0:7922:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea63e5d90 20000000:00000080:0.0:1787833726.613442:0:7922:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df63c3b5400 uarg=0000000000000000 20000000:01000000:0.0:1787833726.613628:0:7922:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787833726.613635:0:7922:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787833726.613647:0:7922:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787833726.613722:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787833726.613732:0:7922:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787833726.618192:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833726.618688:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787833726.618725:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787833726.618744:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787833726.618935:0:7922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787833726.618954:0:7922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.618972:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cea9 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.618979:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf97 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.618986:0:7922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.619024:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cf97 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.619037:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf97 expref: 17 pid: 6506 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833726.619050:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1874679406017152:0@lo:104: 00000100:00100000:0.0:1787833726.619120:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833726.619238:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cea9 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.619246:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cea9 expref: 17 pid: 6508 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833726.619263:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084ab6ee2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1874679406017280:0@lo:104: 00000100:00100000:0.0:1787833726.619297:0:7922:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc57234d going to sleep for 11 seconds 00000100:00100000:2.0:1787833726.621338:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787833726.621392:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833726.621474:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406017152 00000100:00100000:2.0:1787833726.621481:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406017152 00000100:00100000:0.0:1787833726.621897:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406017280 00000100:00100000:0.0:1787833726.621902:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406017280 00000100:00100000:0.0:1787833726.621927:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833726.621934:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f8d1ed8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:7922:x1874679406017152:12345-0@lo:104: 00010000:00010000:0.0:1787833726.621951:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.622041:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833726.622046:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f8d1ed8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:7922:x1874679406017152:12345-0@lo:104: Request processed in 114us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833726.622053:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833726.622099:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787833726.622105:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028ca7e58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:7922:x1874679406017280:12345-0@lo:104: 00010000:00010000:0.0:1787833726.622113:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.622151:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787833726.622155:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028ca7e58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:7922:x1874679406017280:12345-0@lo:104: Request processed in 51us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833726.622161:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787833726.622181:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787833726.622185:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.622193:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000049c8b92c already unused, calling callback (00000000945acc48) 10000000:00010000:0.0:1787833726.622203:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.622210:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833726.622217:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833726.622222:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787833726.622255:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.622262:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833726.622402:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833726.622407:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833726.622413:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fcf5a993 already unused, calling callback (00000000945acc48) 10000000:00010000:1.0:1787833726.622415:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833726.622421:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833726.622426:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833726.622430:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787833726.622446:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833726.622474:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833726.622490:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833726.622495:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 00000000fcf5a993/0x996d2fb20dc1cea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ceb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833726.622510:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833726.622511:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833726.622513:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833726.622525:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f341e331 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406017536:0@lo:103: 00000100:00100000:1.0:1787833726.622575:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833726.622623:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406017536 00000100:00100000:1.0:1787833726.622628:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406017536 00010000:00010000:1.0:1787833726.622648:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cea9 expref: 18 pid: 6508 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833726.622668:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787833726.622674:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096a0cafc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3638:x1874679406017536:12345-0@lo:103: 00010000:00010000:1.0:1787833726.622684:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833726.622688:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cea9 expref: 18 pid: 6508 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833726.622697:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cea9 expref: 18 pid: 6508 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833726.622713:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833726.622740:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096a0cafc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3638:x1874679406017536:12345-0@lo:103: Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833726.622778:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787833726.622813:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f341e331 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406017536:0@lo:103: 00000100:00100000:3.0:1787833726.623064:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000082630e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406017408:0@lo:103: 00000100:00100000:3.0:1787833726.623096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833726.623155:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012e6b685 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1874679406017152:0@lo:104: 00010000:00010000:3.0:1787833726.623164:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b20c161d/0x996d2fb20dc1ceb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cea9 expref: 17 pid: 6508 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833726.623174:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084ab6ee2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1874679406017280:0@lo:104: 00010000:00010000:3.0:1787833726.623189:0:7922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623250:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623257:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 0000000049c8b92c/0x996d2fb20dc1cf97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cf9e expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623272:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833726.623273:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833726.623274:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833726.623306:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406017408 00000100:00100000:0.0:1787833726.623310:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406017408 00010000:00010000:0.0:1787833726.623324:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf97 expref: 17 pid: 6506 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833726.623343:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787833726.623348:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1d91c7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:3641:x1874679406017408:12345-0@lo:103: 00010000:00010000:0.0:1787833726.623356:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833726.623366:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf97 expref: 17 pid: 6506 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623374:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf97 expref: 17 pid: 6506 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623608:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008f4f908a/0x996d2fb20dc1cf9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cf97 expref: 17 pid: 6506 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623622:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623629:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623641:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623647:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623652:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623657:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623662:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fcb09f73 already unused, calling callback (000000008ec170e8) 00010000:00010000:0.0:1787833726.623665:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623671:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623688:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833726.623696:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833726.623731:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1d91c7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:3641:x1874679406017408:12345-0@lo:103: Request processed in 383us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833726.623737:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787833726.623788:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000082630e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406017408:0@lo:103: 00010000:00010000:3.0:1787833726.623861:0:7922:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833726.623868:0:7922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833726.623873:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fcb09f73/0x996d2fb20dc1d031 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833726.743173:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833727.776033:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833728.342208:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833728.342233:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c249e5d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406017664:0@lo:41: 00000100:00100000:2.0:1787833728.342311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833728.342516:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406017664 00000100:00100000:3.0:1787833728.342523:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406017664 00000100:00100000:3.0:1787833728.342589:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787833728.342596:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1a08f3f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406017664:12345-0@lo:41: 00000004:00000024:3.0:1787833728.342632:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787833728.342675:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1a08f3f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406017664:12345-0@lo:41: Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833728.342681:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787833728.342704:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000025e532f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406017920:0@lo:400: 00000100:00100000:3.0:1787833728.342740:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833728.342795:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833728.342801:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005aa3152e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406017792:0@lo:400: 00000100:00100000:3.0:1787833728.342828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833728.343020:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c22acf6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406018048:0@lo:400: 00000100:00100000:2.0:1787833728.343063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833728.343108:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c249e5d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406017664:0@lo:41: 00000100:00100000:2.0:1787833728.343125:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833728.343129:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069870552 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406018176:0@lo:400: 00000100:00100000:3.0:1787833728.343234:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406018048 00000100:00100000:3.0:1787833728.343239:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406018048 00000100:00100000:3.0:1787833728.343268:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787833728.343274:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046ef6301 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406018048:12345-0@lo:400: 00000100:00100000:3.0:1787833728.343322:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046ef6301 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406018048:12345-0@lo:400: Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833728.343328:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787833728.343896:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406017920 00000100:00100000:0.0:1787833728.343903:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406017920 00000100:00100000:0.0:1787833728.343941:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787833728.343948:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b5d8742 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406017920:12345-0@lo:400: 00000100:00100000:0.0:1787833728.343995:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b5d8742 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406017920:12345-0@lo:400: Request processed in 47us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833728.344001:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833728.344260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833728.344308:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c22acf6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406018048:0@lo:400: 00000100:00100000:2.0:1787833728.344339:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406017792 00000100:00100000:2.0:1787833728.344342:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406017792 00000100:00100000:2.0:1787833728.344370:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787833728.344376:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009603af26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:3641:x1874679406017792:12345-0@lo:400: 00000100:00100000:2.0:1787833728.344408:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009603af26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:3641:x1874679406017792:12345-0@lo:400: Request processed in 33us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833728.344414:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787833728.344481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406018176 00000100:00100000:0.0:1787833728.344485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406018176 00000100:00100000:0.0:1787833728.344515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787833728.344521:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c249e5d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406018176:12345-0@lo:400: 00000100:00100000:0.0:1787833728.344565:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c249e5d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406018176:12345-0@lo:400: Request processed in 45us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833728.344583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787833728.344825:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000069870552 x1874679406018176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833728.344836:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069870552 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406018176:0@lo:400: 00000100:00100000:3.0:1787833728.344916:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005aa3152e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406017792:0@lo:400: 00010000:00080000:3.0:1787833728.344927:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000025e532f x1874679406017920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833728.344936:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000025e532f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406017920:0@lo:400: 00010000:00010000:0.0:1787833728.790318:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833729.814512:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833729.878783:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000082630e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406018304:0@lo:41: 00000100:00100000:3.0:1787833729.878866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833729.879064:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406018304 00000100:00100000:0.0:1787833729.879072:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406018304 00000100:00100000:0.0:1787833729.879122:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787833729.879130:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000025e532f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406018304:12345-0@lo:41: 00000004:00000024:0.0:1787833729.879177:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787833729.879225:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000025e532f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406018304:12345-0@lo:41: Request processed in 96us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833729.879232:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787833729.889060:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000082630e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406018304:0@lo:41: 00010000:00010000:1.0:1787833730.838246:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787833731.414059:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787833731.414067:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63b1db800 from 1 10000000:01000000:0.0:1787833731.414073:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787833731.414128:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000fcb09f73/0x996d2fb20dc1d038 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833731.414140:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000fcb09f73/0x996d2fb20dc1d038 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833731.414150:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000fcb09f73/0x996d2fb20dc1d038 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833731.414171:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d2ded21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406018432:0@lo:101: 00000100:00100000:0.0:1787833731.414238:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833731.414288:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a53a356e going to sleep for 11 seconds 00000100:00100000:2.0:1787833731.414343:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406018432 00000100:00100000:2.0:1787833731.414354:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406018432 00000100:00100000:2.0:1787833731.414410:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787833731.414418:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000635ae059 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406018432:12345-0@lo:101: 00010000:00010000:2.0:1787833731.414442:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833731.414453:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003447f073/0x996d2fb20dc1d03f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d038 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833731.414475:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003447f073/0x996d2fb20dc1d03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d038 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833731.414484:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003447f073/0x996d2fb20dc1d03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d038 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833731.414568:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003447f073, rc 0) 00000100:00100000:2.0:1787833731.414621:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000635ae059 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406018432:12345-0@lo:101: Request processed in 204us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833731.414628:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787833731.414705:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d2ded21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406018432:0@lo:101: 00010000:00010000:0.0:1787833731.414718:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000fcb09f73/0x996d2fb20dc1d038 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833731.414727:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000fcb09f73/0x996d2fb20dc1d038 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833731.414808:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d2ded21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406018560:0@lo:501: 00000100:00100000:0.0:1787833731.414836:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833731.414868:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a53a356e going to sleep for 11 seconds 00000100:00100000:2.0:1787833731.415227:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406018560 00000100:00100000:2.0:1787833731.415232:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406018560 00000100:00100000:2.0:1787833731.415268:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787833731.415276:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082e57d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406018560:12345-0@lo:501: 00000100:00100000:2.0:1787833731.415401:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082e57d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406018560:12345-0@lo:501: Request processed in 126us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833731.415408:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787833731.416879:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d2ded21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406018560:0@lo:501: 00000100:00100000:0.0:1787833731.416946:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d2ded21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406018688:0@lo:503: 00000100:00100000:0.0:1787833731.417021:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833731.417057:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a53a356e going to sleep for 11 seconds 00000100:00100000:2.0:1787833731.417610:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406018688 00000100:00100000:2.0:1787833731.417618:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406018688 00000100:00100000:2.0:1787833731.417679:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787833731.417687:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e7c63e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406018688:12345-0@lo:503: 00000100:00100000:2.0:1787833731.417836:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e7c63e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406018688:12345-0@lo:503: Request processed in 150us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833731.417844:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787833731.417991:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d2ded21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406018688:0@lo:503: 00000100:00100000:3.0:1787833731.418858:0:8128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005aa3152e pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8128:1874679406018816:0@lo:502: 00000100:00100000:3.0:1787833731.418916:0:8128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833731.418949:0:8128:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e7e1f0d going to sleep for 11 seconds 00000100:00100000:2.0:1787833731.419055:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406018816 00000100:00100000:2.0:1787833731.419061:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406018816 00000100:00100000:2.0:1787833731.419109:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787833731.419116:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009469249e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:8128:x1874679406018816:12345-0@lo:502: 00000100:00100000:2.0:1787833731.419643:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009469249e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:8128:x1874679406018816:12345-0@lo:502: Request processed in 525us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833731.419650:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787833731.419733:0:8128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005aa3152e pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8128:1874679406018816:0@lo:502: 00000020:01000000:3.0:1787833731.419796:0:8128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833731.419806:0:8128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833731.419808:0:8128:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787833731.419821:0:8128:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df63b1db800 00000020:00000080:3.0:1787833731.419824:0:8128:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787833731.419864:0:8128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8128:1874679406018944:0@lo:502: 00000100:00100000:3.0:1787833731.419897:0:8128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833731.420075:0:8128:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612d22a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833731.420123:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406018944 00000100:00100000:2.0:1787833731.420267:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406018944 00000100:00100000:2.0:1787833731.420340:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787833731.420348:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:8128:x1874679406018944:12345-0@lo:502: 00000100:00100000:2.0:1787833731.420432:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:8128:x1874679406018944:12345-0@lo:502: Request processed in 84us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833731.420439:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787833731.420517:0:8128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8128:1874679406018944:0@lo:502: 00000020:01000000:3.0:1787833731.420537:0:8128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833731.420541:0:8128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833731.420543:0:8128:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787833731.420548:0:8128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787833731.422313:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787833731.422350:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833731.422363:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833731.422376:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833731.422387:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787833731.422390:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df60efc3000 from 1 10000000:01000000:1.0:1787833731.422392:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833731.422433:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833731.422441:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833731.422452:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833731.422473:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406019072:0@lo:101: 00000100:00100000:1.0:1787833731.422546:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833731.423291:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112ee840 going to sleep for 11 seconds 00000100:00100000:0.0:1787833731.423561:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406019072 00000100:00100000:0.0:1787833731.423569:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406019072 00000100:00100000:0.0:1787833731.423612:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787833731.423620:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406019072:12345-0@lo:101: 00010000:00010000:0.0:1787833731.423632:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833731.423648:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d046 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833731.423672:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d046 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833731.423683:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d046 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833731.423691:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030600, rc 0) 00000100:00100000:0.0:1787833731.423841:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406019072:12345-0@lo:101: Request processed in 220us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833731.423848:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787833731.424276:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406019072:0@lo:101: 00010000:00010000:1.0:1787833731.424307:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833731.424315:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833731.424384:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406019200:0@lo:501: 00000100:00100000:1.0:1787833731.424418:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833731.424450:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112ee840 going to sleep for 11 seconds 00000100:00100000:0.0:1787833731.424503:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406019200 00000100:00100000:0.0:1787833731.424610:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406019200 00000100:00100000:0.0:1787833731.424680:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787833731.424687:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406019200:12345-0@lo:501: 00000100:00100000:0.0:1787833731.424830:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406019200:12345-0@lo:501: Request processed in 143us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833731.424837:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787833731.424901:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406019200:0@lo:501: 00000100:00100000:1.0:1787833731.424929:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406019328:0@lo:503: 00000100:00100000:1.0:1787833731.424979:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833731.425362:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112ee840 going to sleep for 11 seconds 00000100:00100000:3.0:1787833731.425400:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406019328 00000100:00100000:3.0:1787833731.425405:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406019328 00000100:00100000:3.0:1787833731.425451:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787833731.425459:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406019328:12345-0@lo:503: 00000100:00100000:3.0:1787833731.425559:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406019328:12345-0@lo:503: Request processed in 100us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833731.425565:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787833731.429209:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406019328:0@lo:503: 00000100:00100000:0.0:1787833731.437384:0:8130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8130:1874679406019456:0@lo:502: 00000100:00100000:0.0:1787833731.437468:0:8130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833731.437592:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406019456 00000100:00100000:1.0:1787833731.437599:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406019456 00000100:00100000:1.0:1787833731.437640:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787833731.437648:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:8130:x1874679406019456:12345-0@lo:502: 00000100:00100000:1.0:1787833731.443666:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:8130:x1874679406019456:12345-0@lo:502: Request processed in 6008us (6188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833731.443682:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787833731.446388:0:8130:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833731.446429:0:8130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8130:1874679406019456:0@lo:502: 00000020:01000000:0.0:1787833731.446474:0:8130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833731.446485:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833731.446497:0:8130:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787833731.446518:0:8130:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df60efc3000 00000020:00000080:0.0:1787833731.446521:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787833731.446561:0:8130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8130:1874679406019584:0@lo:502: 00000100:00100000:0.0:1787833731.446630:0:8130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833731.446660:0:8130:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833731.447629:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406019584 00000100:00100000:1.0:1787833731.447663:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406019584 00000100:00100000:1.0:1787833731.447792:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787833731.447817:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:8130:x1874679406019584:12345-0@lo:502: 00000100:00100000:1.0:1787833731.450854:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:8130:x1874679406019584:12345-0@lo:502: Request processed in 3044us (4214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833731.450883:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787833731.452391:0:8130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8130:1874679406019584:0@lo:502: 00000020:01000000:0.0:1787833731.452444:0:8130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833731.452456:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833731.452459:0:8130:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787833731.452468:0:8130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787833731.453424:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787833731.453449:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787833731.453460:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833731.453470:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833731.864048:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833732.886555:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833733.462358:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406020096:0@lo:400: 00000100:00100000:3.0:1787833733.462456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833733.462611:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787833733.462621:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406019712:0@lo:400: 00000100:00100000:3.0:1787833733.462660:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833733.462690:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406020224:0@lo:400: 00000100:00100000:3.0:1787833733.462717:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833733.462779:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406019840:0@lo:400: 00000100:00100000:3.0:1787833733.462805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833733.462824:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833733.462837:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406019968:0@lo:400: 00000100:00100000:3.0:1787833733.462864:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833733.462891:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406020224 00000100:00100000:3.0:1787833733.462896:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406019712 00000100:00100000:2.0:1787833733.462899:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406020224 00000100:00100000:3.0:1787833733.462901:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406019712 00000100:00100000:2.0:1787833733.462952:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406019968 00000100:00100000:2.0:1787833733.462956:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406019968 00000100:00100000:3.0:1787833733.462959:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787833733.462971:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3640:x1874679406019712:12345-0@lo:400: 00000100:00100000:2.0:1787833733.462978:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833733.462987:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406020224:12345-0@lo:400: 00000100:00100000:3.0:1787833733.463029:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3640:x1874679406019712:12345-0@lo:400: Request processed in 60us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833733.463037:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787833733.463052:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406020224:12345-0@lo:400: Request processed in 66us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833733.463061:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787833733.463076:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406020096 00000100:00100000:3.0:1787833733.463081:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406020096 00000100:00100000:2.0:1787833733.463091:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833733.463100:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406019968:12345-0@lo:400: 00000100:00100000:3.0:1787833733.463108:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406019840 00000100:00100000:3.0:1787833733.463112:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406019840 00000100:00100000:3.0:1787833733.463132:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787833733.463140:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406020096:12345-0@lo:400: 00000100:00100000:2.0:1787833733.463146:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406019968:12345-0@lo:400: Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833733.463163:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787833733.463179:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406020096:12345-0@lo:400: Request processed in 39us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833733.463186:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787833733.463197:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787833733.463201:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406019840:12345-0@lo:400: 00000100:00100000:3.0:1787833733.463224:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406019840:12345-0@lo:400: Request processed in 23us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833733.463229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787833733.463267:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406019968:0@lo:400: 00010000:00080000:3.0:1787833733.463278:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6212fda40 x1874679406019840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833733.463288:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406019840:0@lo:400: 00000100:00100000:3.0:1787833733.463326:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406019712:0@lo:400: 00000100:00100000:3.0:1787833733.463335:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406020224:0@lo:400: 00010000:00080000:3.0:1787833733.463358:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6212fe1c0 x1874679406020096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833733.463368:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406020096:0@lo:400: 00000100:00100000:1.0:1787833733.468969:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833733.468995:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406020352:0@lo:41: 00000100:00100000:1.0:1787833733.469143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833733.469197:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406020352 00000100:00100000:1.0:1787833733.469207:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406020352 00000100:00100000:1.0:1787833733.469251:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833733.469259:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406020352:12345-0@lo:41: 00000004:00000024:1.0:1787833733.469289:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787833733.469993:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406020352:12345-0@lo:41: Request processed in 622us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833733.470005:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833733.470286:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406020352:0@lo:41: 00010000:00010000:0.0:1787833733.910876:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833734.938092:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833734.998825:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406020480:0@lo:41: 00000100:00100000:1.0:1787833734.998902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833734.999014:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406020480 00000100:00100000:0.0:1787833734.999021:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406020480 00000100:00100000:0.0:1787833734.999082:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787833734.999092:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406020480:12345-0@lo:41: 00000004:00000024:0.0:1787833734.999124:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787833734.999175:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406020480:12345-0@lo:41: Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833734.999183:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787833734.999226:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406020480:0@lo:41: 00010000:00010000:2.0:1787833735.960220:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833736.984434:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833738.005858:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787833738.229060:0:8423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787833738.229064:0:8423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787833738.229066:0:8423:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787833738.229211:0:8423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df6359b9000 00000020:01000004:2.0:1787833738.229229:0:8423:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787833738.229242:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787833738.229256:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8df60ef49a48) 00000020:00000080:2.0:1787833738.229273:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787833738.314338:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787833738.314401:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1787833738.397580:0:8423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787833738.398089:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787833738.398101:0:8423:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787833738.398114:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x996d2fb20dc1d05b 00000020:01000004:0.0:1787833738.398122:0:8423:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787833738.398142:0:8423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787833738.398146:0:8423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787833738.398153:0:8423:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787833738.398158:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787833738.398168:0:8423:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8df62ea93490) 00000020:00000080:0.0:1787833738.398179:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1787833738.401012:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833738.401221:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787833738.401228:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787833738.412371:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787833738.412381:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787833738.420961:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787833738.420977:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787833738.433148:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833738.433370:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787833738.433376:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787833738.447564:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787833738.447581:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787833738.507575:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833738.507981:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787833738.507989:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787833738.512355:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787833738.512372:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787833738.515287:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787833738.515305:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787833738.518145:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833738.518346:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787833738.518352:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787833738.519290:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787833738.519300:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787833738.571716:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833738.571973:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787833738.571980:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787833738.574201:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787833738.574215:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787833738.575277:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787833738.575310:0:8423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787833738.575317:0:8423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000100:00100000:0.0:1787833738.581968:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406020608:0@lo:41: 00000100:00100000:0.0:1787833738.582039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833738.582235:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406020608 00000100:00100000:1.0:1787833738.582243:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406020608 00000100:00100000:1.0:1787833738.582302:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787833738.582312:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406020608:12345-0@lo:41: 00000004:00000024:1.0:1787833738.582344:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787833738.582401:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406020608:12345-0@lo:41: Request processed in 90us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.582409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787833738.582464:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406020608:0@lo:41: 00000100:00100000:2.0:1787833738.589372:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406020864:0@lo:400: 00000100:00100000:2.0:1787833738.589441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.589503:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833738.589509:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406020992:0@lo:400: 00000100:00100000:2.0:1787833738.589537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.589576:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406020864 00000100:00100000:2.0:1787833738.589582:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406020864 00000100:00100000:2.0:1787833738.589630:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833738.589640:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406020864:12345-0@lo:400: 00000100:00100000:2.0:1787833738.589689:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406020864:12345-0@lo:400: Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.589697:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833738.589720:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406020992 00000100:00100000:2.0:1787833738.589724:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406020992 00000100:00100000:2.0:1787833738.589747:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787833738.589777:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406020992:12345-0@lo:400: 00000100:00100000:2.0:1787833738.589809:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406020992:12345-0@lo:400: Request processed in 34us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.589840:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787833738.589879:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406020992:0@lo:400: 00010000:00080000:2.0:1787833738.589893:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6359a0000 x1874679406020864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833738.589904:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406020864:0@lo:400: 00000100:00100000:2.0:1787833738.589932:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406021120:0@lo:400: 00000100:00100000:2.0:1787833738.589958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.589983:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833738.589989:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406020736:0@lo:400: 00000100:00100000:2.0:1787833738.590015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.590044:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406021120 00000100:00100000:1.0:1787833738.590345:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406020736 00000100:00100000:1.0:1787833738.590350:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406020736 00000100:00100000:1.0:1787833738.590400:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787833738.590407:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3640:x1874679406020736:12345-0@lo:400: 00000100:00100000:1.0:1787833738.590466:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3640:x1874679406020736:12345-0@lo:400: Request processed in 47us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.590473:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787833738.592167:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406021120 00000100:00100000:2.0:1787833738.592246:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833738.592256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406021120:12345-0@lo:400: 00000100:00100000:2.0:1787833738.592341:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406021120:12345-0@lo:400: Request processed in 87us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.592348:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833738.592398:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406020736:0@lo:400: 00010000:00080000:2.0:1787833738.592416:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6359a3c00 x1874679406021120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833738.592428:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406021120:0@lo:400: 00000040:01000000:3.0:1787833738.609393:0:8423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787833738.609443:0:8423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787833738.609448:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787833738.609450:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787833738.609451:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833738.609452:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833738.609464:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833738.609466:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833738.609467:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833738.609469:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787833738.609470:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787833738.609471:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833738.609472:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787833738.609476:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787833738.609483:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787833738.609484:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787833738.609485:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833738.609486:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833738.609487:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833738.609489:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833738.609490:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833738.609491:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787833738.609491:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787833738.609492:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833738.609493:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787833738.609518:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787833738.609537:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406021248:0@lo:253: 00000100:00100000:3.0:1787833738.609605:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.609717:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787833738.609898:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406021248 00000100:00100000:0.0:1787833738.609906:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406021248 00000100:00100000:0.0:1787833738.610002:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787833738.610012:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:8423:x1874679406021248:12345-0@lo:253: 20000000:01000000:0.0:1787833738.610061:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787833738.610067:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787833738.610145:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787833738.610150:0:6507:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787833738.610630:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833738.611380:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787833738.611400:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787833738.611419:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787833738.611425:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787833738.611439:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787833738.611464:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787833738.611604:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787833738.611623:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:0.0:1787833738.611626:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:0.0:1787833738.611651:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787833738.611659:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787833738.611675:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787833738.611680:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:0.0:1787833738.611692:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787833738.611699:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787833738.611710:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787833738.611725:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787833738.612325:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1787833738.612340:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:0.0:1787833738.612342:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:0.0:1787833738.612357:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1787833738.612364:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787833738.612377:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1787833738.612382:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:0.0:1787833738.612394:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1787833738.612399:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787833738.612412:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1787833738.612444:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1787833738.613515:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1787833738.613535:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:0.0:1787833738.613537:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:0.0:1787833738.613557:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1787833738.613564:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787833738.613577:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1787833738.613583:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:0.0:1787833738.613595:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1787833738.613602:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787833738.613615:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1787833738.613628:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1787833738.613655:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787833738.613658:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787833738.613662:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787833738.613709:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787833738.613712:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787833738.616220:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787833738.616487:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787833738.616516:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787833738.616531:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787833738.616542:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787833738.616545:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787833738.617356:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1787833738.617382:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1787833738.617396:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787833738.617597:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1787833738.617617:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1787833738.617632:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1787833738.617646:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787833738.617648:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787833738.618222:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1787833738.618253:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1787833738.618279:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787833738.618501:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787833738.618521:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787833738.618535:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787833738.618544:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787833738.618545:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787833738.618920:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1787833738.618951:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1787833738.618967:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1787833738.619110:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1787833738.619130:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1787833738.619143:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1787833738.619159:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787833738.619178:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619196:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6013fc200/0x996d2fb20dc1cf35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cf2e expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619214:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6421c9600/0x996d2fb20dc1cfac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfa5 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619221:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6013fda00/0x996d2fb20dc1cfe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfdd expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619228:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cff9 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619234:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d02a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d023 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619242:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619278:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d023 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619293:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d023 expref: 18 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.619307:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c21680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021376:0@lo:104: 00000100:00100000:1.0:1787833738.619382:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833738.619439:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cff9 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619448:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cff9 expref: 18 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.619467:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021504:0@lo:104: 00000100:00100000:1.0:1787833738.619504:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833738.619536:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6013fda00/0x996d2fb20dc1cfe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cfdd expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619546:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6013fda00/0x996d2fb20dc1cfe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfdd expref: 18 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.619554:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021632:0@lo:104: 00000100:00100000:1.0:1787833738.619575:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833738.619591:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6421c9600/0x996d2fb20dc1cfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cfa5 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619599:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6421c9600/0x996d2fb20dc1cfac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfa5 expref: 18 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.619606:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021760:0@lo:104: 00000100:00100000:1.0:1787833738.619639:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833738.619656:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6013fc200/0x996d2fb20dc1cf35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cf2e expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.619664:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6013fc200/0x996d2fb20dc1cf35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf2e expref: 18 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.619672:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021888:0@lo:104: 00000100:00100000:1.0:1787833738.619689:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833738.619698:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833738.619957:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406021376 00000100:00100000:2.0:1787833738.619964:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406021376 00000100:00100000:2.0:1787833738.619997:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406021504 00000100:00100000:2.0:1787833738.620000:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406021504 00000100:00100000:2.0:1787833738.620008:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406021632 00000100:00100000:2.0:1787833738.620010:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406021632 00000100:00100000:2.0:1787833738.620018:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406021760 00000100:00100000:2.0:1787833738.620021:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406021760 00000100:00100000:2.0:1787833738.620030:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406021888 00000100:00100000:2.0:1787833738.620032:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406021888 00000100:00100000:2.0:1787833738.620054:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833738.620063:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+7:6507:x1874679406021376:12345-0@lo:104: 00010000:00010000:2.0:1787833738.620082:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1d023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620141:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833738.620146:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+7:6507:x1874679406021376:12345-0@lo:104: Request processed in 85us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.620153:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833738.620171:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787833738.620176:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:6507:x1874679406021504:12345-0@lo:104: 00010000:00010000:2.0:1787833738.620183:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6421c9c00/0x996d2fb20dc1cff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620219:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787833738.620224:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:6507:x1874679406021504:12345-0@lo:104: Request processed in 48us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.620239:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787833738.620252:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833738.620257:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6507:x1874679406021632:12345-0@lo:104: 00010000:00010000:2.0:1787833738.620265:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1cfdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620298:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787833738.620303:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6507:x1874679406021632:12345-0@lo:104: Request processed in 46us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.620309:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833738.620321:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833738.620327:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6507:x1874679406021760:12345-0@lo:104: 00010000:00010000:2.0:1787833738.620334:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6421c8c00/0x996d2fb20dc1cfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620360:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787833738.620365:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6507:x1874679406021760:12345-0@lo:104: Request processed in 39us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.620370:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833738.620381:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833738.620386:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6507:x1874679406021888:12345-0@lo:104: 00010000:00010000:2.0:1787833738.620394:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1cf2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620418:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787833738.620423:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6507:x1874679406021888:12345-0@lo:104: Request processed in 38us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.620434:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787833738.620453:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787833738.620469:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1d023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620476:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833738.620480:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1d023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620488:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1d023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833738.620494:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1d023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833738.620500:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833738.620528:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1d023 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620534:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833738.620549:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1d023 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620556:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1d023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d02a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620568:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787833738.620571:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6421c9c00/0x996d2fb20dc1cff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620586:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6421c9c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833738.620588:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c9c00/0x996d2fb20dc1cff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620594:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6421c9c00/0x996d2fb20dc1cff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833738.620600:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c9c00/0x996d2fb20dc1cff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833738.620605:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833738.620617:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6421c9c00/0x996d2fb20dc1cff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620622:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833738.620633:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6421c9c00/0x996d2fb20dc1cff9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620639:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6421c9c00/0x996d2fb20dc1cff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d000 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620650:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787833738.620653:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1cfdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620659:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833738.620661:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1cfdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620677:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1cfdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833738.620683:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1cfdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833738.620688:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833738.620700:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1cfdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620705:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833738.620710:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1cfdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620715:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1cfdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cfe4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620724:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787833738.620727:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6421c8c00/0x996d2fb20dc1cfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620733:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6421c8c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833738.620735:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c8c00/0x996d2fb20dc1cfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620742:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6421c8c00/0x996d2fb20dc1cfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833738.620770:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c8c00/0x996d2fb20dc1cfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833738.620782:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833738.620797:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6421c8c00/0x996d2fb20dc1cfa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620802:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833738.620807:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6421c8c00/0x996d2fb20dc1cfa5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620814:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6421c8c00/0x996d2fb20dc1cfa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cfac expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620823:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833738.620826:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1cf2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620831:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833738.620834:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1cf2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620841:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1cf2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833738.620846:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1cf2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833738.620851:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833738.620863:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1cf2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620868:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833738.620879:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1cf2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620885:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1cf2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cf35 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.620897:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833738.620899:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833738.620901:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833738.620908:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833738.620928:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406022400:0@lo:103: 00000100:00100000:2.0:1787833738.620962:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.620997:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787833738.621002:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406022016:0@lo:103: 00000100:00100000:2.0:1787833738.621020:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.621033:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406022528:0@lo:103: 00000100:00100000:2.0:1787833738.621050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.621070:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406022144:0@lo:103: 00000100:00100000:2.0:1787833738.621098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.621112:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833738.621116:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406022272:0@lo:103: 00000100:00100000:2.0:1787833738.621135:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.621157:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406022400 00000100:00100000:2.0:1787833738.621162:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406022400 00010000:00010000:2.0:1787833738.621182:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6421c9600/0x996d2fb20dc1cfac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfa5 expref: 19 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833738.621197:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406022016 00000100:00100000:2.0:1787833738.621200:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406022016 00010000:00010000:2.0:1787833738.621217:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d02a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d023 expref: 20 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833738.621228:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406022528 00000100:00100000:2.0:1787833738.621230:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406022528 00010000:00010000:2.0:1787833738.621238:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6013fc200/0x996d2fb20dc1cf35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf2e expref: 21 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833738.621247:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406022144 00000100:00100000:2.0:1787833738.621249:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406022144 00010000:00010000:2.0:1787833738.621257:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d000 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cff9 expref: 22 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833738.621266:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406022272 00000100:00100000:2.0:1787833738.621268:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406022272 00010000:00010000:2.0:1787833738.621278:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6013fda00/0x996d2fb20dc1cfe4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfdd expref: 23 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833738.621289:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833738.621295:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3640:x1874679406022400:12345-0@lo:103: 00010000:00010000:2.0:1787833738.621314:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833738.621319:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6421c9600/0x996d2fb20dc1cfac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfa5 expref: 23 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621327:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6421c9600/0x996d2fb20dc1cfac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfa5 expref: 23 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621342:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833738.621372:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3640:x1874679406022400:12345-0@lo:103: Request processed in 77us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.621378:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833738.621398:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787833738.621404:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:3640:x1874679406022016:12345-0@lo:103: 00010000:00010000:2.0:1787833738.621412:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833738.621416:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d02a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d023 expref: 22 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621425:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d023 expref: 22 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621436:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833738.621470:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:3640:x1874679406022016:12345-0@lo:103: Request processed in 66us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.621477:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787833738.621489:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833738.621494:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3640:x1874679406022528:12345-0@lo:103: 00010000:00010000:2.0:1787833738.621501:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833738.621506:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6013fc200/0x996d2fb20dc1cf35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf2e expref: 21 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621515:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6013fc200/0x996d2fb20dc1cf35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cf2e expref: 21 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621524:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833738.621544:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3640:x1874679406022528:12345-0@lo:103: Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.621550:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833738.621560:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833738.621566:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3638:x1874679406022144:12345-0@lo:103: 00010000:00010000:2.0:1787833738.621572:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833738.621581:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d000 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cff9 expref: 20 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621589:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cff9 expref: 20 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621598:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833738.621622:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3638:x1874679406022144:12345-0@lo:103: Request processed in 56us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.621627:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833738.621638:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833738.621644:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e149c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3638:x1874679406022272:12345-0@lo:103: 00010000:00010000:2.0:1787833738.621651:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833738.621655:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6013fda00/0x996d2fb20dc1cfe4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfdd expref: 19 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621663:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6013fda00/0x996d2fb20dc1cfe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfdd expref: 19 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621673:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621681:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621694:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621700:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621706:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621718:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621724:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6421c8e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833738.621728:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621736:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621744:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.621775:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833738.621799:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e149c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3638:x1874679406022272:12345-0@lo:103: Request processed in 155us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.621805:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833738.621870:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406022272:0@lo:103: 00000100:00100000:2.0:1787833738.621879:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406022144:0@lo:103: 00000100:00100000:2.0:1787833738.621902:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406022016:0@lo:103: 00000100:00100000:2.0:1787833738.621908:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406022528:0@lo:103: 00000100:00100000:2.0:1787833738.621914:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406022400:0@lo:103: 00010000:00010000:3.0:1787833738.621999:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833738.622519:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d02a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d023 expref: 18 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.622534:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c21680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021376:0@lo:104: 00010000:00010000:1.0:1787833738.622553:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cff9 expref: 17 pid: 6507 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.622561:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021504:0@lo:104: 00010000:00010000:1.0:1787833738.622570:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6013fda00/0x996d2fb20dc1cfe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cfdd expref: 16 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.622579:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021632:0@lo:104: 00010000:00010000:1.0:1787833738.622587:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6421c9600/0x996d2fb20dc1cfac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cfa5 expref: 15 pid: 6506 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.622594:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021760:0@lo:104: 00010000:00010000:1.0:1787833738.622603:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6013fc200/0x996d2fb20dc1cf35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cf2e expref: 14 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.622611:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874679406021888:0@lo:104: 00010000:00010000:1.0:1787833738.622634:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.622643:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.622649:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.622655:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d069 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787833738.622668:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787833738.632020:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:8423:x1874679406021248:12345-0@lo:253: Request processed in 21999us (22404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.632034:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787833738.634106:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406021248:0@lo:253: 10000000:01000000:3.0:1787833738.634126:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787833738.634130:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787833738.634131:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787833738.634133:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833738.634134:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787833738.634136:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833738.634137:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833738.634139:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833738.634141:0:8423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787833738.634143:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833738.634164:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787833738.634189:0:8423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df6359b9000 from lustre-OST0000 10000000:01000000:3.0:1787833738.634228:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787833738.634231:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787833738.634241:0:8423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df60ec73490 local copy 10000000:01000000:3.0:1787833738.634245:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787833738.634287:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.634298:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.634320:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833738.634351:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406022656:0@lo:101: 00000100:00100000:3.0:1787833738.634417:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.634470:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833738.635110:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406022656 00000100:00100000:1.0:1787833738.635119:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406022656 00000100:00100000:1.0:1787833738.635205:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787833738.635216:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+13:8423:x1874679406022656:12345-0@lo:101: 00010000:00010000:1.0:1787833738.635229:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833738.635245:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d070 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.635269:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d070 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.635280:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d070 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.635289:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6421c8600, rc 0) 00000100:00100000:1.0:1787833738.635356:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406022656:12345-0@lo:101: Request processed in 142us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.635363:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787833738.635425:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406022656:0@lo:101: 00010000:00010000:3.0:1787833738.635439:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.635448:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833738.635545:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406022784:0@lo:501: 00000100:00100000:3.0:1787833738.635576:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.636220:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833738.636271:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406022784 00000100:00100000:2.0:1787833738.636277:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406022784 00000100:00100000:2.0:1787833738.636373:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787833738.636382:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406022784:12345-0@lo:501: 00000100:00100000:2.0:1787833738.636534:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406022784:12345-0@lo:501: Request processed in 154us (958us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787833738.636542:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787833738.636737:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406022784:0@lo:501: 10000000:01000000:3.0:1787833738.638879:0:8423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787833738.639207:0:8423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787833738.639218:0:8423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.639230:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.639238:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.639263:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787833738.639299:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df6359b9000 10000000:01000000:3.0:1787833738.639373:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787833738.639379:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787833738.639382:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787833738.639387:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787833738.639390:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787833738.639421:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.639429:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.639440:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833738.639471:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406022912:0@lo:101: 00000100:00100000:3.0:1787833738.639535:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.639580:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787833738.639638:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833738.639646:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.639653:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833738.639657:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.639665:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833738.639673:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833738.639679:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833738.639699:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.639705:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833738.639736:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.639743:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b247000/0x996d2fb20dc1d070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x996d2fb20dc1d077 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.639774:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833738.639776:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833738.639787:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833738.639839:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406022912 00000100:00100000:1.0:1787833738.639847:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406022912 00000100:00100000:1.0:1787833738.639899:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787833738.639909:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406022912:12345-0@lo:101: 00010000:00010000:1.0:1787833738.639921:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833738.639934:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d07e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.639967:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d07e expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.639977:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d07e expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.639986:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6421c9400, rc 0) 00000100:00100000:1.0:1787833738.640024:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406022912:12345-0@lo:101: Request processed in 117us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.640031:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787833738.640204:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833738.640217:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502512580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406023040:0@lo:103: 00000100:00100000:0.0:1787833738.640250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.640388:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406023040 00000100:00100000:2.0:1787833738.640392:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406023040 00000100:00100000:2.0:1787833738.640432:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833738.640444:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3639:x1874679406023040:12345-0@lo:103: 00010000:00010000:2.0:1787833738.640462:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833738.640474:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d070 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.640485:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833738.640519:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:3639:x1874679406023040:12345-0@lo:103: Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.640525:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833738.640557:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502512580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406023040:0@lo:103: 00000100:00100000:3.0:1787833738.640642:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406022912:0@lo:101: 00010000:00010000:3.0:1787833738.640665:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.640673:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833738.640775:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023168:0@lo:501: 00000100:00100000:3.0:1787833738.640804:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.640827:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833738.640892:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406023168 00000100:00100000:2.0:1787833738.640896:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406023168 00000100:00100000:2.0:1787833738.640923:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787833738.640929:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406023168:12345-0@lo:501: 00000100:00100000:2.0:1787833738.641027:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406023168:12345-0@lo:501: Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.641034:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787833738.641232:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023168:0@lo:501: 00000100:00100000:3.0:1787833738.641278:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023296:0@lo:503: 00000100:00100000:3.0:1787833738.641476:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.641537:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833738.641572:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406023296 00000100:00100000:2.0:1787833738.641577:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406023296 00000100:00100000:1.0:1787833738.641647:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787833738.641659:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406023296:12345-0@lo:503: 00000100:00100000:1.0:1787833738.641776:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406023296:12345-0@lo:503: Request processed in 119us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.641784:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787833738.641943:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023296:0@lo:503: 00000040:00080000:3.0:1787833738.642238:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787833738.642332:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023424:0@lo:502: 00000100:00100000:3.0:1787833738.642376:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.642398:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833738.642602:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406023424 00000100:00100000:0.0:1787833738.642607:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406023424 00000100:00100000:0.0:1787833738.642644:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787833738.642653:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406023424:12345-0@lo:502: 00000100:00100000:0.0:1787833738.642785:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406023424:12345-0@lo:502: Request processed in 132us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833738.642792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787833738.643176:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023424:0@lo:502: 00000040:00080000:3.0:1787833738.643465:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787833738.643494:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787833738.643508:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787833738.643522:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787833738.643534:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787833738.643547:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787833738.643569:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023552:0@lo:502: 00000100:00100000:3.0:1787833738.643616:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.643639:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833738.643700:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406023552 00000100:00100000:0.0:1787833738.643705:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406023552 00000100:00100000:0.0:1787833738.643809:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787833738.643818:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406023552:12345-0@lo:502: 00000100:00100000:0.0:1787833738.643897:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406023552:12345-0@lo:502: Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833738.643904:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787833738.643996:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023552:0@lo:502: 00000040:00080000:3.0:1787833738.644033:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787833738.644040:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787833738.644816:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787833738.644825:0:8446:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787833738.644832:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833738.644834:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787833738.644838:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833738.644852:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8df634431a48) 00000020:00000080:3.0:1787833738.644871:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787833738.644876:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787833738.644949:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df6359b9000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787833738.644956:0:8446:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787833738.644963:0:8446:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x996d2fb20dc1d093 00010000:00010000:3.0:1787833738.654914:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1787833738.656789:0:8446:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787833738.663211:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787833738.663582:0:8446:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787833738.672599:0:8446:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787833738.672846:0:8446:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787833738.680556:0:8446:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787833738.682858:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787833738.682872:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833738.682878:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833738.682881:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787833738.682884:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833738.682888:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833738.682889:0:8446:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787833738.682893:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787833738.682900:0:8446:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787833738.682924:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833738.682927:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833738.682928:0:8446:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787833738.682932:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787833738.683019:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787833738.683054:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787833738.683081:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.683093:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833738.683112:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df6359b9000 from 1 10000000:01000000:3.0:1787833738.683114:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833738.683148:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.683155:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.683166:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833738.683187:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023680:0@lo:101: 00000100:00100000:3.0:1787833738.683252:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.683320:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5010849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833738.685817:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406023680 00000100:00100000:0.0:1787833738.685831:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406023680 00000100:00100000:0.0:1787833738.685881:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787833738.685891:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:8423:x1874679406023680:12345-0@lo:101: 00010000:00010000:0.0:1787833738.685907:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833738.685925:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d09a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833738.685952:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d09a expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833738.685962:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d09a expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833738.685970:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031400, rc 0) 00000100:00100000:0.0:1787833738.686054:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406023680:12345-0@lo:101: Request processed in 164us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833738.686061:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787833738.689113:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023680:0@lo:101: 00010000:00010000:1.0:1787833738.689141:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.689153:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.689268:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023808:0@lo:501: 00000100:00100000:1.0:1787833738.689327:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833738.689369:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833738.689395:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406023808 00000100:00100000:2.0:1787833738.689401:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406023808 00000100:00100000:2.0:1787833738.689449:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787833738.689469:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406023808:12345-0@lo:501: 00000100:00100000:2.0:1787833738.689582:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406023808:12345-0@lo:501: Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.689596:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787833738.691267:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023808:0@lo:501: 00000100:00100000:1.0:1787833738.691323:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023936:0@lo:503: 00000100:00100000:1.0:1787833738.691384:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833738.691422:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833738.691485:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406023936 00000100:00100000:0.0:1787833738.691490:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406023936 00000100:00100000:0.0:1787833738.691538:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787833738.691546:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406023936:12345-0@lo:503: 00000100:00100000:0.0:1787833738.691643:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406023936:12345-0@lo:503: Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833738.691651:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787833738.691940:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406023936:0@lo:503: 00000040:00080000:3.0:1787833738.692157:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787833738.692215:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024064:0@lo:502: 00000100:00100000:3.0:1787833738.692248:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.692277:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833738.692331:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406024064 00000100:00100000:1.0:1787833738.692335:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406024064 00000100:00100000:1.0:1787833738.692364:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787833738.692369:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406024064:12345-0@lo:502: 00000100:00100000:1.0:1787833738.692445:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406024064:12345-0@lo:502: Request processed in 76us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.692464:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787833738.692620:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024064:0@lo:502: 00000040:00080000:3.0:1787833738.692820:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787833738.692845:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787833738.692865:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024192:0@lo:502: 00000100:00100000:3.0:1787833738.692898:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.692909:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833738.693343:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406024192 00000100:00100000:1.0:1787833738.693348:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406024192 00000100:00100000:1.0:1787833738.693384:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787833738.693390:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406024192:12345-0@lo:502: 00000100:00100000:1.0:1787833738.693543:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406024192:12345-0@lo:502: Request processed in 152us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.693550:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787833738.693763:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024192:0@lo:502: 00000040:00080000:2.0:1787833738.693814:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787833738.693822:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787833738.698250:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833738.698262:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833738.698264:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787833738.698271:0:8450:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df6359b9000 00000020:00000080:2.0:1787833738.698274:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787833738.698286:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833738.698288:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833738.698289:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787833738.698292:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787833738.698432:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787833738.698587:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833738.698609:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.698621:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833738.698670:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787833738.698674:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df6359b9000 10000000:01000000:3.0:1787833738.698677:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df6359b9000 10000000:01000000:3.0:1787833738.698682:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787833738.698687:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df6359b9000 from 1 10000000:01000000:3.0:1787833738.698690:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787833738.698723:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.698731:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.698742:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833738.698855:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024320:0@lo:101: 00000100:00100000:3.0:1787833738.698921:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.700876:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084300 going to sleep for 11 seconds 00000100:00100000:0.0:1787833738.715646:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406024320 00000100:00100000:0.0:1787833738.715664:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406024320 00000100:00100000:0.0:1787833738.715743:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787833738.715770:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8423:x1874679406024320:12345-0@lo:101: 00010000:00010000:0.0:1787833738.715789:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833738.715810:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d0a8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833738.716413:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d0a8 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833738.716427:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d0a8 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833738.716437:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031a00, rc 0) 00000100:00100000:0.0:1787833738.716529:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406024320:12345-0@lo:101: Request processed in 777us (17606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833738.716535:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787833738.718698:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024320:0@lo:101: 00010000:00010000:3.0:1787833738.718726:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833738.718738:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833738.718905:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024448:0@lo:501: 00000100:00100000:3.0:1787833738.718963:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.719007:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833738.719012:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406024448 00000100:00100000:1.0:1787833738.719018:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406024448 00000100:00100000:1.0:1787833738.719063:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787833738.719072:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406024448:12345-0@lo:501: 00000100:00100000:1.0:1787833738.719171:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406024448:12345-0@lo:501: Request processed in 101us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.719177:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787833738.719295:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024448:0@lo:501: 00000100:00100000:3.0:1787833738.719321:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024576:0@lo:503: 00000100:00100000:3.0:1787833738.719360:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.719372:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833738.719392:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406024576 00000100:00100000:1.0:1787833738.719397:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406024576 00000100:00100000:1.0:1787833738.719429:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787833738.719442:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406024576:12345-0@lo:503: 00000100:00100000:1.0:1787833738.719537:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406024576:12345-0@lo:503: Request processed in 95us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.719544:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787833738.719582:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024576:0@lo:503: 00000040:00080000:1.0:1787833738.719871:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787833738.719930:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024704:0@lo:502: 00000100:00100000:1.0:1787833738.719962:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833738.719976:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787833738.719989:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406024704 00000100:00100000:1.0:1787833738.719992:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406024704 00000100:00100000:1.0:1787833738.720009:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787833738.720015:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406024704:12345-0@lo:502: 00000100:00100000:1.0:1787833738.720094:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406024704:12345-0@lo:502: Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833738.720101:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787833738.720138:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024704:0@lo:502: 00000040:00080000:1.0:1787833738.720300:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787833738.720549:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787833738.720561:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787833738.720573:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787833738.720585:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787833738.720596:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787833738.720608:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787833738.720620:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787833738.720632:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787833738.720643:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787833738.720664:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787833738.720675:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787833738.721162:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787833738.721182:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787833738.721196:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787833738.721208:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787833738.721221:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787833738.721233:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787833738.721245:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787833738.721257:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787833738.721284:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787833738.721298:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787833738.722067:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787833738.722083:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787833738.722097:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787833738.722111:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787833738.722124:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787833738.722136:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787833738.722148:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787833738.722161:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787833738.722173:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787833738.722185:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787833738.722197:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787833738.722209:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787833738.722222:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787833738.722234:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787833738.722262:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1787833738.722549:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024832:0@lo:502: 00000100:00100000:1.0:1787833738.722624:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833738.722669:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833738.722681:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406024832 00000100:00100000:3.0:1787833738.722687:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406024832 00000100:00100000:3.0:1787833738.722733:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787833738.722741:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406024832:12345-0@lo:502: 00000100:00100000:3.0:1787833738.722871:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406024832:12345-0@lo:502: Request processed in 130us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833738.722878:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787833738.722927:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406024832:0@lo:502: 00000040:00080000:1.0:1787833738.722980:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787833738.723094:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787833738.724264:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787833738.724293:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df5027c1a48) 00000020:00000080:0.0:1787833738.724326:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787833738.724412:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df6359b9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787833738.724417:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df6359b9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787833738.724420:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df6359b9000 3 00010000:00080000:0.0:1787833738.724449:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df62ea25800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.117@tcp at head 00010000:00010000:0.0:1787833738.726589:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1787833738.726817:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787833738.726862:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787833738.726875:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x996d2fb20dc1d0bd 00000100:00080000:0.0:1787833738.726886:0:8451:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787833738.726898:0:8451:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df62ea25800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787833738.726933:0:8451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df621338b40 x1874679406024960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787833738.726955:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787833738.727139:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406024960:0@lo:38: 00000020:01000004:0.0:1787833738.727179:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787833738.727191:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8df5027c3490) 00000020:00000080:0.0:1787833738.727203:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:3.0:1787833738.727210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787833738.727263:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df6359b9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787833738.727267:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df6359b9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787833738.727270:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df6359b9000 3 00010000:00080000:0.0:1787833738.727298:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df502d1a000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.117@tcp at head 00000100:00100000:2.0:1787833738.729252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406024960 00000100:00100000:2.0:1787833738.729265:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406024960 00000100:00100000:2.0:1787833738.729305:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833738.729313:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406024960:12345-0@lo:38: 00010000:00080000:2.0:1787833738.729341:0:6513:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1787833738.729371:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x996d2fb20dc1d0cb 00000004:00100000:2.0:1787833738.729386:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787833738.729420:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8df63c486800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833738.729522:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874679406024960:12345-0@lo:38: Request processed in 209us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.729529:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787833738.729579:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df621338b40 x1874679406024960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833738.729589:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787833738.729597:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787833738.729611:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787833738.729615:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787833738.729618:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df62ea25800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787833738.729625:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406024960:0@lo:38: 00010000:00010000:1.0:1787833738.737664:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1787833738.737944:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787833738.738002:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787833738.738014:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x996d2fb20dc1d0d2 00000100:00080000:1.0:1787833738.738024:0:8451:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787833738.738029:0:8451:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8df502d1a000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787833738.738059:0:8451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df5025083c0 x1874679406025088/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787833738.738078:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787833738.738546:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406025088:0@lo:38: 00000100:00100000:3.0:1787833738.738619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833738.738694:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406025088 00000100:00100000:3.0:1787833738.738699:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406025088 00000100:00100000:3.0:1787833738.738730:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833738.738735:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406025088:12345-0@lo:38: 00010000:00080000:3.0:1787833738.738775:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1787833738.738806:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x996d2fb20dc1d0d9 00000004:00100000:3.0:1787833738.738827:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787833738.738858:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8df502526000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833738.738906:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874679406025088:12345-0@lo:38: Request processed in 169us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833738.738913:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787833738.738950:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df5025083c0 x1874679406025088/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833738.738960:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787833738.738967:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787833738.738973:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787833738.738977:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787833738.738980:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502d1a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787833738.738985:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406025088:0@lo:38: 00000040:00080000:1.0:1787833738.741689:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787833738.741809:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787833738.741851:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787833738.741873:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.741886:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787833738.741935:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787833738.741937:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787833738.741939:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833738.741940:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833738.741941:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833738.741943:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833738.741944:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787833738.741946:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833738.741947:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833738.741949:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833738.741950:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787833738.741958:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787833738.741960:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787833738.741961:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787833738.741962:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833738.741963:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833738.741964:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833738.741965:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833738.741965:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787833738.741966:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833738.741967:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833738.741968:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833738.741969:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787833738.741994:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787833738.742010:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406025216:0@lo:253: 00000100:00100000:1.0:1787833738.742076:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833738.742315:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787833738.744626:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406025216 00000100:00100000:3.0:1787833738.744641:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406025216 00000100:00100000:3.0:1787833738.744707:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787833738.744718:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406025216:12345-0@lo:253: 20000000:01000000:3.0:1787833738.744786:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787833738.744803:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787833738.763812:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787833738.763828:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787833738.765627:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787833738.765637:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787833738.765659:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833738.765674:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:8423:x1874679406025216:12345-0@lo:253: Request processed in 20955us (23593us total) trans 0 rc 0/0 00010000:00010000:1.0:1787833738.765675:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1cfd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfcf expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.765683:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1cff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1cfeb expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833738.765685:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00010000:1.0:1787833738.765691:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.765730:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1cff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cfeb expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.765743:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1cff2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfeb expref: 15 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.765804:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406025344:0@lo:104: 00000100:00100000:2.0:1787833738.765914:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:8423:1874679406025216:0@lo:253: 10000000:01000000:2.0:1787833738.765928:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787833738.765930:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787833738.765932:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833738.765933:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833738.765934:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833738.765935:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833738.765937:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833738.765938:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833738.765940:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833738.765941:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833738.765943:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833738.765944:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787833738.765959:0:8423:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787833738.771117:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833738.771253:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1cfd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1cfcf expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833738.771270:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1cfd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfcf expref: 15 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833738.771287:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406025472:0@lo:104: 00000100:00100000:1.0:1787833738.771681:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0c00 going to sleep for 11 seconds 00080000:10000000:2.0:1787833738.776697:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787833738.776883:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787833738.777103:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787833738.777252:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787833738.777441:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787833738.777667:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1787833738.777734:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787833738.777790:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833738.777824:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406025344 00000100:00100000:0.0:1787833738.777831:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406025344 00000100:00100000:0.0:1787833738.777875:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406025472 00000100:00100000:0.0:1787833738.777878:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406025472 00000100:00100000:0.0:1787833738.777892:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787833738.777899:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b339450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6530:x1874679406025344:12345-0@lo:104: 00010000:00010000:0.0:1787833738.777917:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1cfeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833738.777987:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833738.777993:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b339450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6530:x1874679406025344:12345-0@lo:104: Request processed in 94us (6885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833738.778000:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787833738.778032:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787833738.778038:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6530:x1874679406025472:12345-0@lo:104: 00010000:00010000:0.0:1787833738.778055:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b247800/0x996d2fb20dc1cfcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833738.778096:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787833738.778102:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6530:x1874679406025472:12345-0@lo:104: Request processed in 64us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833738.778108:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833738.778442:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406025344:0@lo:104: 00000100:00100000:1.0:1787833738.778464:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406025472:0@lo:104: 00010000:00010000:1.0:1787833738.778489:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787833738.780412:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1787833738.785163:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787833738.785177:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1cfeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785188:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6421c9800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833738.785192:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1cfeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785218:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1cfeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833738.785225:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1cfeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833738.785230:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833738.785292:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1cfeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785299:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833738.785321:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1cfeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785329:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1cfeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cff2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785347:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833738.785351:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b247800/0x996d2fb20dc1cfcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785356:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833738.785359:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247800/0x996d2fb20dc1cfcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785366:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b247800/0x996d2fb20dc1cfcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833738.785373:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247800/0x996d2fb20dc1cfcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833738.785383:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833738.785398:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b247800/0x996d2fb20dc1cfcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785404:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833738.785427:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b247800/0x996d2fb20dc1cfcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785434:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b247800/0x996d2fb20dc1cfcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1cfd6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.785448:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833738.785450:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833738.785451:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833738.785611:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833738.785701:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502512580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406025600:0@lo:103: 00000100:00100000:2.0:1787833738.785789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.785850:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833738.785858:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502511680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406025728:0@lo:103: 00000100:00100000:2.0:1787833738.785881:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.785910:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406025600 00000100:00100000:2.0:1787833738.785916:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406025600 00010000:00010000:2.0:1787833738.785942:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1cff2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfeb expref: 16 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833738.785967:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406025728 00000100:00100000:2.0:1787833738.785971:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406025728 00010000:00010000:2.0:1787833738.785982:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1cfd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfcf expref: 17 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833738.786009:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833738.786017:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502513c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:3639:x1874679406025600:12345-0@lo:103: 00010000:00010000:2.0:1787833738.786028:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833738.786034:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1cff2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfeb expref: 17 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786046:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1cff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfeb expref: 17 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786061:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1cff2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cfeb expref: 17 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786074:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833738.786167:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787833738.786176:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787833738.786244:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502513c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:3639:x1874679406025600:12345-0@lo:103: Request processed in 227us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.786252:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833738.786270:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787833738.786276:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3641:x1874679406025728:12345-0@lo:103: 00010000:00010000:2.0:1787833738.786284:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833738.786289:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1cfd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfcf expref: 15 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786299:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1cfd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1cfcf expref: 15 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786311:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1cfd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1cfcf expref: 15 pid: 6508 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786333:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786340:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787833738.786354:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.020717501s 00010000:00010000:2.0:1787833738.786358:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786365:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786373:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786380:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786385:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6421c8e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833738.786390:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786398:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786411:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786421:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833738.786450:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:3641:x1874679406025728:12345-0@lo:103: Request processed in 174us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833738.786580:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502512580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406025600:0@lo:103: 00000100:00100000:2.0:1787833738.786627:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787833738.786656:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502511680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406025728:0@lo:103: 00010000:00010000:2.0:1787833738.786675:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786683:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833738.786689:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d0e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787833738.802697:0:8423:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787833738.802707:0:8423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787833738.802746:0:8423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787833738.802827:0:8423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787833738.802853:0:8423:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787833738.802888:0:8423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787833738.803580:0:8423:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787833738.803771:0:8423:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787833739.037263:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787833739.925369:0:8508:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787833739.926066:0:8508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787833740.056115:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833740.147459:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406025856:0@lo:41: 00000100:00100000:3.0:1787833740.147533:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833740.147605:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406025856 00000100:00100000:3.0:1787833740.147611:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406025856 00000100:00100000:3.0:1787833740.147652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787833740.147660:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406025856:12345-0@lo:41: 00000004:00000024:3.0:1787833740.147693:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1787833740.147742:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406025856:12345-0@lo:41: Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833740.147765:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787833740.147812:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406025856:0@lo:41: 00010000:00010000:3.0:1787833741.083998:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787833741.207789:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787833741.207797:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df63b1db800 from 30 10000000:01000000:2.0:1787833741.207803:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833741.208966:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833741.208982:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833741.208997:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833741.209020:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502512940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406025984:0@lo:101: 00000100:00100000:2.0:1787833741.209087:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833741.209148:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612e60900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833741.210980:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406025984 00000100:00100000:3.0:1787833741.210993:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406025984 00000100:00100000:3.0:1787833741.211048:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787833741.211057:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:6511:x1874679406025984:12345-0@lo:101: 00010000:00010000:3.0:1787833741.211073:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833741.211092:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d0e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833741.211120:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d0e7 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833741.211140:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d0e7 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833741.211149:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246a00, rc 0) 00000100:00100000:3.0:1787833741.211215:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406025984:12345-0@lo:101: Request processed in 160us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833741.211222:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787833741.211282:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502512940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406025984:0@lo:101: 00010000:00010000:3.0:1787833741.212058:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833741.212068:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833741.212144:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a46580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026112:0@lo:501: 00000100:00100000:3.0:1787833741.212189:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833741.212264:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833741.219494:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406026112 00000100:00100000:2.0:1787833741.219508:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406026112 00000100:00100000:2.0:1787833741.219783:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787833741.219793:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406026112:12345-0@lo:501: 00000100:00100000:2.0:1787833741.220185:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406026112:12345-0@lo:501: Request processed in 390us (7993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833741.220193:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787833741.220256:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a46580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026112:0@lo:501: 00000100:00100000:2.0:1787833741.220320:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502510780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026240:0@lo:503: 00000100:00100000:2.0:1787833741.220367:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833741.220399:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612e603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833741.220414:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406026240 00000100:00100000:2.0:1787833741.220418:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406026240 00000100:00100000:2.0:1787833741.220453:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787833741.220460:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406026240:12345-0@lo:503: 00000100:00100000:2.0:1787833741.220549:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406026240:12345-0@lo:503: Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833741.220555:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787833741.220594:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502510780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026240:0@lo:503: 00000100:00100000:1.0:1787833741.241059:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8570:1874679406026368:0@lo:502: 00000100:00100000:1.0:1787833741.241151:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.241194:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833741.242542:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406026368 00000100:00100000:0.0:1787833741.242555:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406026368 00000100:00100000:0.0:1787833741.242626:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787833741.242641:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8570:x1874679406026368:12345-0@lo:502: 00000100:00100000:0.0:1787833741.242844:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8570:x1874679406026368:12345-0@lo:502: Request processed in 209us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833741.242852:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787833741.242928:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8570:1874679406026368:0@lo:502: 00000100:00100000:1.0:1787833741.243002:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8570:1874679406026496:0@lo:502: 00000100:00100000:1.0:1787833741.243042:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.243084:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605387c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833741.243530:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406026496 00000100:00100000:0.0:1787833741.243537:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406026496 00000100:00100000:0.0:1787833741.243580:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787833741.243588:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8570:x1874679406026496:12345-0@lo:502: 00000100:00100000:0.0:1787833741.243672:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:8570:x1874679406026496:12345-0@lo:502: Request processed in 84us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833741.243679:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787833741.244200:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8570:1874679406026496:0@lo:502: 00000040:00080000:1.0:1787833741.244225:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787833741.244314:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787833741.244341:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787833741.244352:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.244365:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833741.244382:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787833741.244385:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df63b1db800 from 5 10000000:01000000:0.0:1787833741.244388:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787833741.244426:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.244434:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.244459:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833741.244475:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026624:0@lo:101: 00000100:00100000:0.0:1787833741.244511:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.244548:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.244944:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406026624 00000100:00100000:1.0:1787833741.244950:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406026624 00000100:00100000:1.0:1787833741.244995:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787833741.245003:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406026624:12345-0@lo:101: 00010000:00010000:1.0:1787833741.245014:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833741.245027:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d0f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.245048:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d0f5 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.245059:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d0f5 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.245077:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6421c9c00, rc 0) 00000100:00100000:1.0:1787833741.245118:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406026624:12345-0@lo:101: Request processed in 116us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.245124:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787833741.245298:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026624:0@lo:101: 00010000:00010000:0.0:1787833741.245312:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.245321:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833741.245367:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026752:0@lo:256: 00000100:00100000:0.0:1787833741.245401:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.245432:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.246259:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406026752 00000100:00100000:1.0:1787833741.246267:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406026752 00000100:00100000:1.0:1787833741.246316:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787833741.246326:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406026752:12345-0@lo:256: 20000000:01000000:1.0:1787833741.246344:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787833741.246360:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787833741.246363:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787833741.246482:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406026752:12345-0@lo:256: Request processed in 157us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.246489:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787833741.246535:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026752:0@lo:256: 10000000:01000000:0.0:1787833741.246587:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787833741.246600:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.246610:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833741.246619:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787833741.246621:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1787833741.246624:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787833741.246654:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.246661:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.246669:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833741.246682:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026880:0@lo:101: 00000100:00100000:0.0:1787833741.246716:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.247128:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.249522:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406026880 00000100:00100000:1.0:1787833741.249548:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406026880 00000100:00100000:1.0:1787833741.249611:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787833741.249622:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406026880:12345-0@lo:101: 00010000:00010000:1.0:1787833741.249640:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833741.249662:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d103 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.249693:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d103 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.249705:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d103 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.249714:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6421c8c00, rc 0) 00000100:00100000:0.0:1787833741.249906:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406026880:0@lo:101: 00010000:00010000:0.0:1787833741.249927:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.249937:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833741.250574:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406026880:12345-0@lo:101: Request processed in 202us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.250586:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787833741.250646:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406027008:0@lo:501: 00000100:00100000:0.0:1787833741.250709:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.250812:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406027008 00000100:00100000:1.0:1787833741.250817:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406027008 00000100:00100000:1.0:1787833741.251387:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787833741.251396:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406027008:12345-0@lo:501: 00000100:00100000:1.0:1787833741.251526:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406027008:12345-0@lo:501: Request processed in 131us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.251533:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787833741.252590:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787833741.252622:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406027008:0@lo:501: 00000100:00100000:0.0:1787833741.252679:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406027136:0@lo:503: 00000100:00100000:0.0:1787833741.252789:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.252813:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.253102:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406027136 00000100:00100000:1.0:1787833741.253109:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406027136 00000100:00100000:1.0:1787833741.253154:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787833741.253162:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406027136:12345-0@lo:503: 00000100:00100000:1.0:1787833741.253268:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406027136:12345-0@lo:503: Request processed in 105us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.253282:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787833741.254474:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406027136:0@lo:503: 00000100:00100000:1.0:1787833741.257586:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8573:1874679406027264:0@lo:502: 00000100:00100000:1.0:1787833741.257671:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.257720:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df618641480 going to sleep for 11 seconds 00000100:00100000:0.0:1787833741.259064:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406027264 00000100:00100000:0.0:1787833741.259076:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406027264 00000100:00100000:0.0:1787833741.259138:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787833741.259148:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:8573:x1874679406027264:12345-0@lo:502: 00000100:00100000:0.0:1787833741.259306:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:8573:x1874679406027264:12345-0@lo:502: Request processed in 159us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833741.259314:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787833741.262793:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8573:1874679406027264:0@lo:502: 00000020:01000000:1.0:1787833741.262855:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787833741.262863:0:8573:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787833741.262876:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833741.262878:0:8573:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787833741.262884:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787833741.262887:0:8573:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:1.0:1787833741.262916:0:8573:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787833741.262919:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787833741.262937:0:8573:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8df635863490) 00000020:00000080:1.0:1787833741.262961:0:8573:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1787833741.262968:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787833741.263070:0:8573:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787833741.263077:0:8573:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787833741.263084:0:8573:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1d118 00010000:00080000:1.0:1787833741.263117:0:8573:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df5027bc000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787833741.263500:0:8573:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787833741.276945:0:8573:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787833741.276975:0:8573:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787833741.277208:0:8573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787833741.282215:0:8573:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787833741.282308:0:8573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787833741.282389:0:8573:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787833741.283075:0:8575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833741.283080:0:8575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787833741.283595:0:8573:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787833741.283606:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787833741.283644:0:8573:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787833741.283666:0:8573:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1d11f 00000100:00080000:1.0:1787833741.283676:0:8573:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787833741.283688:0:8573:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df5027bc000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787833741.283724:0:8573:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502509680 x1874679406027392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833741.284644:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406027392:0@lo:8: 00000100:00100000:3.0:1787833741.284722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787833741.284864:0:8573:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787833741.284995:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406027648:0@lo:400: 00000100:00100000:1.0:1787833741.285027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.285048:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406028160:0@lo:400: 00000100:00100000:1.0:1787833741.285076:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.285099:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787833741.285105:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406027520:0@lo:400: 00000100:00100000:1.0:1787833741.285125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.285142:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406028032:0@lo:400: 00000100:00100000:1.0:1787833741.285178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.285206:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406027776:0@lo:400: 00000100:00100000:1.0:1787833741.285226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.285240:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833741.285244:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406027904:0@lo:400: 00000100:00100000:1.0:1787833741.285262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.285294:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406027648 00000100:00100000:1.0:1787833741.285300:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406027648 00000100:00100000:1.0:1787833741.285337:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406027904 00000100:00100000:1.0:1787833741.285340:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406027904 00000100:00100000:1.0:1787833741.285355:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787833741.285363:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406027648:12345-0@lo:400: 00000100:00100000:1.0:1787833741.285416:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406027648:12345-0@lo:400: Request processed in 54us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.285445:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787833741.285462:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787833741.285469:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406027904:12345-0@lo:400: 00000100:00100000:1.0:1787833741.285503:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406027904:12345-0@lo:400: Request processed in 35us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.285508:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787833741.285529:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406028160 00000100:00100000:1.0:1787833741.285533:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406028160 00000100:00100000:1.0:1787833741.285563:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406027520 00000100:00100000:1.0:1787833741.285566:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406027520 00000100:00100000:1.0:1787833741.285576:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406028032 00000100:00100000:1.0:1787833741.285578:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406028032 00000100:00100000:1.0:1787833741.285588:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406027776 00000100:00100000:1.0:1787833741.285590:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406027776 00000100:00100000:1.0:1787833741.285601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833741.285606:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406028160:12345-0@lo:400: 00000100:00100000:1.0:1787833741.285635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406028160:12345-0@lo:400: Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.285641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833741.285651:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833741.285656:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406027520:12345-0@lo:400: 00000100:00100000:1.0:1787833741.285680:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406027520:12345-0@lo:400: Request processed in 24us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.285685:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833741.285695:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787833741.285701:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406028032:12345-0@lo:400: 00000100:00100000:1.0:1787833741.285726:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406028032:12345-0@lo:400: Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.285738:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787833741.285775:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787833741.285782:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406027776:12345-0@lo:400: 00000100:00100000:1.0:1787833741.285812:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406027776:12345-0@lo:400: Request processed in 32us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.285817:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787833741.285867:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406027904:0@lo:400: 00010000:00080000:1.0:1787833741.285880:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250a940 x1874679406027776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833741.285892:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406027776:0@lo:400: 00010000:00080000:1.0:1787833741.285919:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250bc00 x1874679406027520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833741.285929:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406027520:0@lo:400: 00010000:00080000:1.0:1787833741.285938:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250b0c0 x1874679406028032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833741.285944:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406028032:0@lo:400: 00000100:00100000:1.0:1787833741.285952:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406027648:0@lo:400: 00010000:00080000:1.0:1787833741.285961:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502508000 x1874679406028160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833741.285969:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406028160:0@lo:400: 00000020:01000000:1.0:1787833741.286060:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833741.286067:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833741.286074:0:8573:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787833741.286078:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833741.286082:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833741.286084:0:8573:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787833741.286087:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787833741.286089:0:8573:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787833741.286116:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8573:1874679406028288:0@lo:502: 00000100:00100000:1.0:1787833741.286159:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.286186:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406028288 00000100:00100000:1.0:1787833741.286190:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406028288 00000100:00100000:1.0:1787833741.286219:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787833741.286225:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:8573:x1874679406028288:12345-0@lo:502: 00000100:00100000:1.0:1787833741.286327:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:8573:x1874679406028288:12345-0@lo:502: Request processed in 101us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.286333:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787833741.286373:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.286383:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8573:1874679406028288:0@lo:502: 00000020:01000000:1.0:1787833741.286400:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833741.286404:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833741.286406:0:8573:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787833741.286409:0:8573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1787833741.286506:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1787833741.286537:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787833741.286550:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.286561:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833741.286572:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787833741.286575:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df60efc3000 from 30 10000000:01000000:0.0:1787833741.286578:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787833741.286673:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.286682:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833741.286698:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833741.286711:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406028416:0@lo:101: 00000100:00100000:0.0:1787833741.286744:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.286798:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.286970:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406028416 00000100:00100000:1.0:1787833741.286975:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406028416 00000100:00100000:1.0:1787833741.287003:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787833741.287010:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406028416:12345-0@lo:101: 00010000:00010000:1.0:1787833741.287021:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833741.287033:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d126 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.287056:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d126 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.287075:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d126 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.287083:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6421c8600, rc 0) 00000100:00100000:1.0:1787833741.287119:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406028416:12345-0@lo:101: Request processed in 109us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.287125:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787833741.287159:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406028416:0@lo:101: 00010000:00010000:1.0:1787833741.287171:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.287179:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833741.287223:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406028544:0@lo:501: 00000100:00100000:1.0:1787833741.287246:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.287266:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.287277:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406028544 00000100:00100000:1.0:1787833741.287280:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406028544 00000100:00100000:1.0:1787833741.287298:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787833741.287303:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406028544:12345-0@lo:501: 00000100:00100000:1.0:1787833741.287403:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406028544:12345-0@lo:501: Request processed in 98us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.287410:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787833741.287454:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406028544:0@lo:501: 00000100:00100000:1.0:1787833741.287476:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406028672:0@lo:503: 00000100:00100000:1.0:1787833741.287518:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.287540:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.287552:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406028672 00000100:00100000:1.0:1787833741.287555:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406028672 00000100:00100000:1.0:1787833741.287573:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787833741.287578:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406028672:12345-0@lo:503: 00000100:00100000:1.0:1787833741.287640:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406028672:12345-0@lo:503: Request processed in 61us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.287647:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787833741.287687:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406028672:0@lo:503: 00000100:00100000:3.0:1787833741.288058:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406027392 00000100:00100000:3.0:1787833741.288063:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406027392 00000100:00100000:3.0:1787833741.288090:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787833741.288096:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874679406027392:12345-0@lo:8: 00010000:00080000:3.0:1787833741.288119:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:3.0:1787833741.288144:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1d134 00002000:00100000:3.0:1787833741.288190:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8df502523800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787833741.288195:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1787833741.288198:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787833741.288260:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787833741.288495:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787833741.288521:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8df502521000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833741.288594:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874679406027392:12345-0@lo:8: Request processed in 497us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833741.288602:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787833741.288849:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833741.288855:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787833741.289070:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502509680 x1874679406027392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787833751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833741.289082:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787833741.289090:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787833741.289097:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787833741.289102:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787833741.289104:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df5027bc000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787833741.289121:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787833741.289125:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406027392:0@lo:8: 00000100:00100000:0.0:1787833741.289222:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8577:1874679406028800:0@lo:502: 00000100:00100000:0.0:1787833741.289276:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.289304:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787833741.289369:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a46d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8576:1874679406028928:0@lo:700: 00000100:00100000:3.0:1787833741.289394:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833741.289418:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.289476:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406028800 00000100:00100000:1.0:1787833741.289481:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406028800 00000100:00100000:1.0:1787833741.289522:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787833741.289530:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:8577:x1874679406028800:12345-0@lo:502: 00000100:00100000:1.0:1787833741.289627:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:8577:x1874679406028800:12345-0@lo:502: Request processed in 97us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.289634:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000004:00080000:1.0:1787833741.289672:0:8575:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787833741.289729:0:8575:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 217202977413ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787833741.289735:0:8575:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787833741.290061:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406028928 00000100:00100000:0.0:1787833741.290067:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406028928 00000100:00100000:0.0:1787833741.290118:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833741.290125:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8576:x1874679406028928:12345-0@lo:700: 00000100:00100000:0.0:1787833741.290159:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8da40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1874679406029056:0@lo:700: 00000100:00100000:0.0:1787833741.290194:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.290213:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833741.290247:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406029056 00000100:00100000:0.0:1787833741.290251:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406029056 00000100:00100000:0.0:1787833741.290276:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833741.290281:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1874679406029056:12345-0@lo:700: 00000100:00100000:0.0:1787833741.290368:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8577:1874679406028800:0@lo:502: 00000100:00100000:0.0:1787833741.290411:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8577:1874679406029184:0@lo:502: 00000100:00100000:0.0:1787833741.290453:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.290472:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406029184 00000100:00100000:0.0:1787833741.290476:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406029184 00000100:00100000:0.0:1787833741.290500:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787833741.290506:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:8577:x1874679406029184:12345-0@lo:502: 00000100:00100000:0.0:1787833741.290579:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:8577:x1874679406029184:12345-0@lo:502: Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833741.290586:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787833741.290625:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833741.290636:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8577:1874679406029184:0@lo:502: 00000040:00080000:0.0:1787833741.290652:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787833741.291207:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787833741.291230:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787833741.291240:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.291251:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833741.291268:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787833741.291270:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60efc3000 from 5 10000000:01000000:1.0:1787833741.291274:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787833741.291302:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.291310:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.291318:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833741.291333:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029312:0@lo:101: 00000100:00100000:1.0:1787833741.291370:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.291401:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.291418:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406029312 00000100:00100000:1.0:1787833741.291422:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406029312 00000100:00100000:1.0:1787833741.291471:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787833741.291478:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406029312:12345-0@lo:101: 00010000:00010000:1.0:1787833741.291488:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833741.291501:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d13b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.291522:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d13b expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.291532:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d13b expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.291553:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6421c8e00, rc 0) 00000100:00100000:1.0:1787833741.291583:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406029312:12345-0@lo:101: Request processed in 106us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.291589:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787833741.291620:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029312:0@lo:101: 00010000:00010000:1.0:1787833741.291632:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.291640:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833741.291680:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029440:0@lo:256: 00000100:00100000:1.0:1787833741.291707:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.291718:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.291729:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406029440 00000100:00100000:1.0:1787833741.291732:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406029440 00000100:00100000:1.0:1787833741.291782:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787833741.291789:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406029440:12345-0@lo:256: 20000000:01000000:1.0:1787833741.291800:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787833741.291815:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787833741.291818:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00080000:3.0:1787833741.291936:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833741.292734:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406029440:12345-0@lo:256: Request processed in 942us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.292743:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787833741.292812:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029440:0@lo:256: 10000000:01000000:1.0:1787833741.293003:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787833741.293016:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.293026:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833741.293036:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787833741.293038:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787833741.293041:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787833741.293066:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.293073:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.293082:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833741.293096:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029568:0@lo:101: 00000100:00100000:1.0:1787833741.293128:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.293152:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.293169:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406029568 00000100:00100000:1.0:1787833741.293174:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406029568 00000100:00100000:1.0:1787833741.293204:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787833741.293211:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406029568:12345-0@lo:101: 00010000:00010000:1.0:1787833741.293221:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833741.293232:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d149 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.293249:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d149 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.293265:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d149 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.293273:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fd800, rc 0) 00000100:00100000:1.0:1787833741.293316:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406029568:12345-0@lo:101: Request processed in 106us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.293322:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787833741.293352:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029568:0@lo:101: 00010000:00010000:1.0:1787833741.293364:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.293372:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833741.293419:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029696:0@lo:501: 00000100:00100000:1.0:1787833741.293457:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.293471:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.293482:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406029696 00000100:00100000:1.0:1787833741.293485:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406029696 00000100:00100000:1.0:1787833741.293505:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787833741.293511:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406029696:12345-0@lo:501: 00000100:00100000:1.0:1787833741.293618:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406029696:12345-0@lo:501: Request processed in 107us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.293625:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787833741.293652:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029696:0@lo:501: 00000100:00100000:1.0:1787833741.293677:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029824:0@lo:503: 00000100:00100000:1.0:1787833741.293721:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.293735:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.293746:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406029824 00000100:00100000:1.0:1787833741.293772:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406029824 00000100:00100000:1.0:1787833741.293793:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787833741.293799:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406029824:12345-0@lo:503: 00000100:00100000:1.0:1787833741.294452:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406029824:12345-0@lo:503: Request processed in 638us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.294460:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787833741.294726:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406029824:0@lo:503: 00000004:00080000:0.0:1787833741.296133:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787833741.296498:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8578:1874679406029952:0@lo:502: 00000100:00100000:0.0:1787833741.296584:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.296629:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.296733:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406029952 00000100:00100000:1.0:1787833741.296740:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406029952 00000100:00100000:1.0:1787833741.297059:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787833741.297073:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:8578:x1874679406029952:12345-0@lo:502: 00000100:00100000:1.0:1787833741.297204:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:8578:x1874679406029952:12345-0@lo:502: Request processed in 134us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.298361:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787833741.298615:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8578:1874679406029952:0@lo:502: 00000020:01000000:0.0:1787833741.298656:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787833741.298666:0:8578:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787833741.298687:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833741.298689:0:8578:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787833741.298695:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787833741.298699:0:8578:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:0.0:1787833741.298723:0:8578:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787833741.298726:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787833741.298741:0:8578:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df5027c0000) 00000020:00000080:0.0:1787833741.298793:0:8578:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787833741.298800:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787833741.298894:0:8578:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787833741.298900:0:8578:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787833741.298908:0:8578:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1d15e 00010000:00080000:0.0:1787833741.299067:0:8578:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df502d1f000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:0.0:1787833741.299376:0:8578:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:0.0:1787833741.302317:0:8578:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787833741.302339:0:8578:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787833741.302629:0:8578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:1.0:1787833741.303041:0:6521:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:00080000:0.0:1787833741.304172:0:8578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833741.304299:0:8578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787833741.304395:0:8578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787833741.307061:0:8580:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833741.307070:0:8580:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787833741.308699:0:8578:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787833741.308714:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787833741.308779:0:8578:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787833741.308805:0:8578:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1d165 00000100:00080000:0.0:1787833741.308815:0:8578:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787833741.309919:0:8578:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df502d1f000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787833741.310033:0:8578:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a8cf00 x1874679406030080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787833741.310063:0:8578:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787833741.310144:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833741.310157:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833741.310160:0:8578:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787833741.310163:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833741.310168:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833741.310169:0:8578:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787833741.310171:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787833741.310173:0:8578:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787833741.310202:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8578:1874679406030208:0@lo:502: 00000100:00100000:0.0:1787833741.310280:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.310320:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df606de3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833741.310965:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406030080:0@lo:8: 00000100:00100000:3.0:1787833741.311033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833741.311205:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406030080 00000100:00100000:2.0:1787833741.311213:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406030080 00000100:00100000:2.0:1787833741.311257:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833741.311264:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1874679406030080:12345-0@lo:8: 00010000:00080000:2.0:1787833741.311296:0:8432:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1787833741.311328:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1d16c 00002000:00100000:2.0:1787833741.311348:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df502eb7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787833741.311352:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787833741.311355:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787833741.311433:0:8432:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1787833741.312142:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406030208 00000100:00100000:0.0:1787833741.312150:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406030208 00000100:00100000:0.0:1787833741.312197:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787833741.312205:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:8578:x1874679406030208:12345-0@lo:502: 00000100:00100000:0.0:1787833741.312349:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:8578:x1874679406030208:12345-0@lo:502: Request processed in 144us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833741.312356:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787833741.312417:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:8578:1874679406030208:0@lo:502: 00000020:01000000:0.0:1787833741.312459:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833741.312465:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833741.312467:0:8578:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787833741.312471:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00080000:2.0:1787833741.313581:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8df502eb4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833741.313665:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874679406030080:12345-0@lo:8: Request processed in 2398us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833741.313675:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787833741.315271:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8cf00 x1874679406030080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787833751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833741.315287:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787833741.316392:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787833741.316403:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787833741.316409:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787833741.316413:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502d1f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787833741.316455:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787833741.316463:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406030080:0@lo:8: 00000004:00080000:3.0:1787833741.316586:0:8580:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787833741.316667:0:8580:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 217229915818ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787833741.316674:0:8580:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787833741.321164:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787833741.321260:0:8581:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787833741.321298:0:8581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8581:1874679406030464:0@lo:7: 00000100:00100000:0.0:1787833741.321366:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.321396:0:8581:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df606de3cc0 going to sleep for 11 seconds 00000020:01000000:1.0:1787833741.322517:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787833741.322561:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787833741.322574:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.322585:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833741.322597:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787833741.322600:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df60ec73490 from 1 10000000:01000000:1.0:1787833741.322603:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787833741.322653:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.322660:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.322669:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833741.322684:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406030592:0@lo:101: 00000100:00100000:1.0:1787833741.322733:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.322804:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a759c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.322823:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406030336:0@lo:13: 00000100:00100000:1.0:1787833741.322855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.322900:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406030464 00000100:00100000:1.0:1787833741.322907:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406030464 00000100:00100000:1.0:1787833741.322963:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787833741.322972:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8581:x1874679406030464:12345-0@lo:7: 00000100:00100000:3.0:1787833741.325144:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1874679406029056:12345-0@lo:700: Request processed in 34855us (34942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833741.325173:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833741.325359:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406030336 00000100:00100000:0.0:1787833741.325368:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406030336 00000100:00100000:0.0:1787833741.325410:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833741.325419:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874679406030336:12345-0@lo:13: 00002000:00000024:0.0:1787833741.325460:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:0.0:1787833741.325511:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874679406030336:12345-0@lo:13: Request processed in 94us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833741.325518:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787833741.325556:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8da40 x1874679406029056/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833741.325569:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8da40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1874679406029056:0@lo:700: 40000000:02000000:0.0:1787833741.325580:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00010000:00080000:2.0:1787833741.338871:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8cf00 x1874679406030336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833741.338902:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406030336:0@lo:13: 00000100:00080000:2.0:1787833741.338943:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833741.344411:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406030592 00000100:00100000:2.0:1787833741.344424:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406030592 00000100:00100000:2.0:1787833741.344507:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787833741.344518:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406030592:12345-0@lo:101: 00010000:00010000:2.0:1787833741.344537:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833741.344555:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d173 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833741.344585:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d173 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833741.344595:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d173 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833741.344604:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f200, rc 0) 00000100:00100000:2.0:1787833741.344690:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406030592:12345-0@lo:101: Request processed in 174us (21956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833741.344710:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787833741.345198:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406030592:0@lo:101: 00010000:00010000:1.0:1787833741.345220:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.345230:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833741.345301:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406030720:0@lo:501: 00000100:00100000:1.0:1787833741.345337:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.345380:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833741.349571:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406030720 00000100:00100000:2.0:1787833741.349588:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406030720 00000100:00100000:2.0:1787833741.349650:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787833741.349661:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406030720:12345-0@lo:501: 00000100:00100000:2.0:1787833741.349807:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406030720:12345-0@lo:501: Request processed in 147us (4469us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787833741.349814:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787833741.351444:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406030720:0@lo:501: 10000000:01000000:1.0:1787833741.351538:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787833741.351550:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833741.351561:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1787833741.367320:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787833741.367333:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787833741.367529:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8576:x1874679406028928:12345-0@lo:700: Request processed in 77398us (78127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833741.367550:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787833741.368194:0:8576:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a46d00 x1874679406028928/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833741.368211:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a46d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8576:1874679406028928:0@lo:700: 00002000:00080000:1.0:1787833741.370671:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787833741.370680:0:8431:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787833741.370790:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8581:x1874679406030464:12345-0@lo:7: Request processed in 47815us (49419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833741.370801:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787833741.371843:0:8581:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8e580 x1874679406030464/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833741.371864:0:8581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8581:1874679406030464:0@lo:7: 00000004:00080000:0.0:1787833741.371877:0:8581:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787833741.371910:0:8581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8581:1874679406030848:0@lo:5: 00000100:00100000:0.0:1787833741.371955:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.372004:0:8581:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df606de3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833741.372163:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406030848 00000100:00100000:2.0:1787833741.372170:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406030848 00000100:00100000:2.0:1787833741.372216:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833741.372225:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8581:x1874679406030848:12345-0@lo:5: 00002000:00080000:2.0:1787833741.372249:0:8430:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787833741.372252:0:8430:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787833741.372571:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8581:x1874679406030848:12345-0@lo:5: Request processed in 347us (615us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787833741.372578:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787833741.372723:0:8581:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8e580 x1874679406030848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833741.372735:0:8581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8581:1874679406030848:0@lo:5: 00000004:00080000:1.0:1787833741.372744:0:8581:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787833741.372784:0:8581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8581:1874679406030976:0@lo:700: 00000100:00100000:1.0:1787833741.372808:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.372834:0:8581:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833741.372955:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406030976 00000100:00100000:2.0:1787833741.372959:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406030976 00000100:00100000:2.0:1787833741.372992:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833741.372999:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8581:x1874679406030976:12345-0@lo:700: 00000001:00080000:0.0:1787833741.384409:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:00080000:0.0:1787833741.384676:0:8576:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787833741.384703:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8576:1874679406031232:0@lo:7: 00000100:00100000:0.0:1787833741.384794:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833741.384921:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406031104:0@lo:13: 00000100:00100000:3.0:1787833741.384952:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833741.384993:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406031104 00000100:00100000:3.0:1787833741.384999:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406031104 00000100:00100000:3.0:1787833741.385044:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833741.385053:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406031104:12345-0@lo:13: 00002000:00000024:3.0:1787833741.385154:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:3.0:1787833741.385202:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406031104:12345-0@lo:13: Request processed in 149us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833741.385209:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787833741.385322:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8fc00 x1874679406031104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833741.385341:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406031104:0@lo:13: 00000100:00100000:2.0:1787833741.385851:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8581:x1874679406030976:12345-0@lo:700: Request processed in 12849us (13038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833741.385860:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833741.385916:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df606de33c0 going to sleep for 11 seconds 00010000:00080000:3.0:1787833741.386208:0:8581:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250ad00 x1874679406030976/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833741.386218:0:8581:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787833741.386230:0:8581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8581:1874679406030976:0@lo:700: 00000004:02000040:3.0:1787833741.392185:0:8581:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1787833741.395233:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406031232 00000100:00100000:0.0:1787833741.395247:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406031232 00000100:00100000:0.0:1787833741.395345:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787833741.395356:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8576:x1874679406031232:12345-0@lo:7: 00000100:00100000:0.0:1787833741.404205:0:8581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8581:1874679406031360:0@lo:5: 00000100:00100000:0.0:1787833741.404272:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.407894:0:8581:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787833741.408425:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787833741.408451:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1787833741.410367:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787833741.410380:0:8431:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787833741.410499:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8576:x1874679406031232:12345-0@lo:7: Request processed in 15142us (25700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833741.410510:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833741.410539:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406031360 00000100:00100000:2.0:1787833741.410545:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406031360 00000100:00100000:2.0:1787833741.410586:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787833741.410594:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8581:x1874679406031360:12345-0@lo:5: 00010000:00080000:0.0:1787833741.410631:0:8576:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8ed00 x1874679406031232/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833741.410646:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8576:1874679406031232:0@lo:7: 00000004:00080000:0.0:1787833741.410658:0:8576:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787833741.410689:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8576:1874679406031488:0@lo:5: 00000100:00100000:0.0:1787833741.410721:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833741.410745:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605391240 going to sleep for 11 seconds 00000100:00100000:3.0:1787833741.412154:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787833741.412167:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406031488 00000100:00100000:3.0:1787833741.412174:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406031488 00000100:00100000:3.0:1787833741.421520:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787833741.421537:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8576:x1874679406031488:12345-0@lo:5: 00002000:00080000:3.0:1787833741.421570:0:8583:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787833741.428302:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8576:x1874679406031488:12345-0@lo:5: Request processed in 6751us (17560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833741.428316:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:2.0:1787833741.430461:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787833741.431528:0:8431:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00010000:00080000:1.0:1787833741.433849:0:8576:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8ed00 x1874679406031488/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833741.433869:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8576:1874679406031488:0@lo:5: 00000004:00080000:1.0:1787833741.433885:0:8576:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787833741.433937:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8576:1874679406031616:0@lo:5: 00000100:00100000:1.0:1787833741.433994:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.434043:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a759c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833741.434300:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406031616 00000100:00100000:3.0:1787833741.434307:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406031616 00000100:00100000:3.0:1787833741.434352:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787833741.434362:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8576:x1874679406031616:12345-0@lo:5: 00002000:00080000:3.0:1787833741.434397:0:8430:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787833741.439697:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8576:x1874679406031616:12345-0@lo:5: Request processed in 5327us (5693us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787833741.439710:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787833741.440528:0:8576:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250a940 x1874679406031616/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833741.440546:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8576:1874679406031616:0@lo:5: 00000004:00080000:1.0:1787833741.440561:0:8576:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1787833741.440603:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8576:1874679406031744:0@lo:900: 00000100:00100000:1.0:1787833741.440646:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833741.440685:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a759c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833741.440743:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406031744 00000100:00100000:3.0:1787833741.440783:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406031744 00000100:00100000:3.0:1787833741.440928:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833741.440939:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8576:x1874679406031744:12345-0@lo:900: 00000100:00100000:3.0:1787833741.440990:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8576:x1874679406031744:12345-0@lo:900: Request processed in 53us (343us total) trans 0 rc 0/0 00010000:00080000:0.0:1787833741.442301:0:8576:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df5025092c0 x1874679406031744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833741.442318:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8576:1874679406031744:0@lo:900: 00000100:00100000:2.0:1787833741.446715:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8581:x1874679406031360:12345-0@lo:5: Request processed in 36115us (42435us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787833741.446730:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787833741.446934:0:8581:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8c780 x1874679406031360/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833757 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833741.446952:0:8581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8581:1874679406031360:0@lo:5: 00000004:00080000:0.0:1787833741.446967:0:8581:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:3.0:1787833741.447428:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787833742.103845:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833743.132932:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833743.702553:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406031872:0@lo:41: 00000100:00100000:2.0:1787833743.702653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833743.702817:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406031872 00000100:00100000:1.0:1787833743.702826:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406031872 00000100:00100000:1.0:1787833743.702895:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787833743.702905:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406031872:12345-0@lo:41: 00000004:00000024:1.0:1787833743.702946:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787833743.703008:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406031872:12345-0@lo:41: Request processed in 105us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833743.703015:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787833743.703061:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406031872:0@lo:41: 00010000:00010000:0.0:1787833744.157023:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833745.177378:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833745.247912:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406032000:0@lo:41: 00000100:00100000:2.0:1787833745.247996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833745.248184:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406032000 00000100:00100000:0.0:1787833745.248192:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406032000 00000100:00100000:0.0:1787833745.248253:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787833745.248263:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406032000:12345-0@lo:41: 00000004:00000024:0.0:1787833745.248299:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787833745.248348:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406032000:12345-0@lo:41: Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833745.248355:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787833745.248526:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406032000:0@lo:41: 00010000:00010000:2.0:1787833746.199229:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833746.773908:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406032128:0@lo:13: 00000100:00100000:2.0:1787833746.773995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833746.774075:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406032128 00000100:00100000:2.0:1787833746.774082:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406032128 00000100:00100000:2.0:1787833746.774133:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787833746.774143:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406032128:12345-0@lo:13: 00002000:00000024:2.0:1787833746.774173:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833746.774234:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406032128:12345-0@lo:13: Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833746.774241:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787833746.774561:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787833746.774593:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502510000 x1874679406032128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833746.774612:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406032128:0@lo:13: 00000100:00100000:2.0:1787833746.778798:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833746.778920:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406032256:0@lo:13: 00000100:00100000:2.0:1787833746.779023:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833746.779076:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406032256 00000100:00100000:2.0:1787833746.779084:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406032256 00000100:00100000:2.0:1787833746.779147:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833746.779157:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874679406032256:12345-0@lo:13: 00002000:00000024:2.0:1787833746.779182:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833746.779238:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874679406032256:12345-0@lo:13: Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833746.779245:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787833746.779279:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787833746.779696:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8f840 x1874679406032256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833746.779717:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406032256:0@lo:13: 00000100:00100000:2.0:1787833746.779854:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502511e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406032512:0@lo:400: 00000100:00100000:2.0:1787833746.780013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833746.780041:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406033024:0@lo:400: 00000100:00100000:2.0:1787833746.780065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833746.780098:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787833746.780105:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502513840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406032384:0@lo:400: 00000100:00100000:2.0:1787833746.780131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833746.780154:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406032896:0@lo:400: 00000100:00100000:2.0:1787833746.780177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833746.780206:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406032512 00000100:00100000:2.0:1787833746.780210:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406032512 00000100:00100000:2.0:1787833746.780242:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406033024 00000100:00100000:2.0:1787833746.780245:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406033024 00000100:00100000:2.0:1787833746.780486:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787833746.780494:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406032512:12345-0@lo:400: 00000100:00100000:2.0:1787833746.780534:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406032512:12345-0@lo:400: Request processed in 41us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833746.780540:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787833746.780553:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787833746.780558:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406033024:12345-0@lo:400: 00000100:00100000:2.0:1787833746.780580:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406033024:12345-0@lo:400: Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833746.780585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787833746.780603:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406032384 00000100:00100000:2.0:1787833746.780606:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406032384 00000100:00100000:2.0:1787833746.780627:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787833746.780632:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3639:x1874679406032384:12345-0@lo:400: 00000100:00100000:2.0:1787833746.780660:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3639:x1874679406032384:12345-0@lo:400: Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833746.780665:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787833746.780688:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406032896 00000100:00100000:2.0:1787833746.780698:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406032896 00000100:00100000:2.0:1787833746.780723:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833746.780728:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502511680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406032896:12345-0@lo:400: 00000100:00100000:2.0:1787833746.780784:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502511680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406032896:12345-0@lo:400: Request processed in 56us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833746.780789:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787833746.780824:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833746.780844:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502513840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406032384:0@lo:400: 00000100:00100000:2.0:1787833746.780854:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406032896:0@lo:400: 00010000:00080000:2.0:1787833746.780865:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502511e00 x1874679406032512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833746.780874:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502511e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406032512:0@lo:400: 00010000:00080000:2.0:1787833746.780883:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502510f00 x1874679406033024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833746.781050:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406033024:0@lo:400: 00000100:00100000:2.0:1787833746.781078:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502510b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406032640:0@lo:400: 00000100:00100000:2.0:1787833746.781106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833746.781169:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502511a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406033152:0@lo:400: 00000100:00100000:2.0:1787833746.781193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833746.781211:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833746.781218:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406032768:0@lo:400: 00000100:00100000:2.0:1787833746.781237:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833746.781272:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406033152 00000100:00100000:2.0:1787833746.781275:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406033152 00000100:00100000:2.0:1787833746.781313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406032768 00000100:00100000:2.0:1787833746.781322:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406032768 00000100:00100000:2.0:1787833746.781338:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787833746.781343:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502511e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406033152:12345-0@lo:400: 00000100:00100000:2.0:1787833746.781414:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502511e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406033152:12345-0@lo:400: Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833746.781420:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787833746.781432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787833746.781438:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406032768:12345-0@lo:400: 00000100:00100000:2.0:1787833746.781464:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406032768:12345-0@lo:400: Request processed in 26us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833746.781470:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787833746.781484:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787833746.781502:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df5025121c0 x1874679406032768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833746.781511:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406032768:0@lo:400: 00010000:00080000:2.0:1787833746.781519:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502511a40 x1874679406033152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833746.781526:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502511a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406033152:0@lo:400: 00000100:00100000:0.0:1787833746.782172:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406032640 00000100:00100000:0.0:1787833746.782180:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406032640 00000100:00100000:0.0:1787833746.782252:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787833746.782261:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406032640:12345-0@lo:400: 00000100:00100000:0.0:1787833746.782342:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406032640:12345-0@lo:400: Request processed in 83us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833746.782349:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787833746.782417:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502510b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406032640:0@lo:400: 00000001:02000400:2.0:1787833746.947897:0:8807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787833747.226661:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787833747.312297:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1787833747.312317:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000020:00000004:0.0:1787833748.107370:0:8859:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787833748.107603:0:8859:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787833748.246019:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833748.829695:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406033280:0@lo:41: 00000100:00100000:3.0:1787833748.829789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833748.829884:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406033280 00000100:00100000:3.0:1787833748.829892:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406033280 00000100:00100000:3.0:1787833748.829941:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787833748.829965:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406033280:12345-0@lo:41: 00000004:00000024:3.0:1787833748.830002:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787833748.830070:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406033280:12345-0@lo:41: Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833748.830078:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787833748.830137:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406033280:0@lo:41: 00010000:00010000:2.0:1787833749.275465:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833750.299896:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833750.358152:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833750.358182:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406033408:0@lo:41: 00000100:00100000:2.0:1787833750.358280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833750.358510:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406033408 00000100:00100000:0.0:1787833750.358520:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406033408 00000100:00100000:0.0:1787833750.358592:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787833750.358602:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406033408:12345-0@lo:41: 00000004:00000024:0.0:1787833750.358638:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787833750.358700:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406033408:12345-0@lo:41: Request processed in 100us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833750.358707:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787833750.358801:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406033408:0@lo:41: 00010000:00010000:3.0:1787833751.321821:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787833751.703098:0:8961:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787833751.703361:0:8961:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787833751.897405:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502513840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406033536:0@lo:13: 00000100:00100000:2.0:1787833751.897481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833751.897563:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406033536 00000100:00100000:2.0:1787833751.897572:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406033536 00000100:00100000:2.0:1787833751.897731:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833751.897741:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406033536:12345-0@lo:13: 00002000:00000024:2.0:1787833751.897796:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833751.897839:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406033536:12345-0@lo:13: Request processed in 99us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833751.897847:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787833751.897869:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787833751.897898:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502513840 x1874679406033536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833751.897909:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787833751.897929:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502513840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406033536:0@lo:13: 00000100:00100000:0.0:1787833751.899051:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406033664:0@lo:13: 00000100:00100000:0.0:1787833751.899108:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833751.899161:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406033664 00000100:00100000:0.0:1787833751.899167:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406033664 00000100:00100000:0.0:1787833751.899209:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787833751.899217:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406033664:12345-0@lo:13: 00002000:00000024:0.0:1787833751.899234:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833751.899270:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406033664:12345-0@lo:13: Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833751.899277:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787833751.899298:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833751.899321:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8cb40 x1874679406033664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833751.899331:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787833751.899347:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406033664:0@lo:13: 00000100:00100000:0.0:1787833751.902511:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406033792:0@lo:400: 00000100:00100000:0.0:1787833751.902621:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833751.902675:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406034304:0@lo:400: 00000100:00100000:0.0:1787833751.902703:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833751.902790:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833751.902799:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406034176:0@lo:400: 00000100:00100000:0.0:1787833751.902827:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833751.902863:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406034304 00000100:00100000:0.0:1787833751.902870:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406034304 00000100:00100000:0.0:1787833751.902915:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787833751.902924:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406034304:12345-0@lo:400: 00000100:00100000:0.0:1787833751.902972:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406034304:12345-0@lo:400: Request processed in 49us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833751.902979:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787833751.903131:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406033792 00000100:00100000:1.0:1787833751.903136:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406033792 00000100:00100000:1.0:1787833751.903164:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787833751.903170:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3641:x1874679406033792:12345-0@lo:400: 00000100:00100000:1.0:1787833751.903208:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3641:x1874679406033792:12345-0@lo:400: Request processed in 38us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833751.903226:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787833751.903351:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406034176 00000100:00100000:0.0:1787833751.903355:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406034176 00000100:00100000:0.0:1787833751.904112:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787833751.904124:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406034176:12345-0@lo:400: 00000100:00100000:0.0:1787833751.904184:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406034176:12345-0@lo:400: Request processed in 63us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833751.904191:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833751.905318:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406033920:0@lo:400: 00000100:00100000:2.0:1787833751.905388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833751.912375:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406034432:0@lo:400: 00000100:00100000:2.0:1787833751.912444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833751.913355:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406033920 00000100:00100000:1.0:1787833751.913376:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406033920 00000100:00100000:1.0:1787833751.913433:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787833751.913442:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502513840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406033920:12345-0@lo:400: 00000100:00100000:1.0:1787833751.913529:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502513840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406033920:12345-0@lo:400: Request processed in 88us (8141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833751.913535:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833751.920521:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406034432 00000100:00100000:2.0:1787833751.920537:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406034432 00000100:00100000:2.0:1787833751.920743:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787833751.920838:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502511a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406034432:12345-0@lo:400: 00000100:00100000:2.0:1787833751.920912:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502511a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406034432:12345-0@lo:400: Request processed in 161us (8467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833751.920919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787833751.920963:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406034048:0@lo:400: 00000100:00100000:2.0:1787833751.921016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833751.921042:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406034560:0@lo:400: 00000100:00100000:2.0:1787833751.921066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833751.921095:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406034048 00000100:00100000:2.0:1787833751.921099:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406034048 00000100:00100000:2.0:1787833751.921124:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787833751.921132:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406034048:12345-0@lo:400: 00000100:00100000:2.0:1787833751.921166:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406034048:12345-0@lo:400: Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833751.921172:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787833751.921187:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406034560 00000100:00100000:2.0:1787833751.921190:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406034560 00000100:00100000:2.0:1787833751.921206:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787833751.921210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406034560:12345-0@lo:400: 00000100:00100000:2.0:1787833751.921238:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406034560:12345-0@lo:400: Request processed in 27us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833751.921244:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787833751.921275:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406034048:0@lo:400: 00010000:00080000:2.0:1787833751.921288:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df63c45b0c0 x1874679406034560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833751.921297:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406034560:0@lo:400: 00010000:00080000:2.0:1787833751.921333:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502509a40 x1874679406034432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833751.921342:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406034432:0@lo:400: 00010000:00080000:2.0:1787833751.921384:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502508000 x1874679406033920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833751.921392:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406033920:0@lo:400: 00000100:00080000:0.0:1787833751.921970:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833751.921975:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787833751.924599:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250a940 x1874679406034176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833751.924618:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406034176:0@lo:400: 00000100:00100000:0.0:1787833751.924631:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406033792:0@lo:400: 00000100:00100000:0.0:1787833751.924643:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406034304:0@lo:400: 00010000:00010000:2.0:1787833752.342419:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787833753.017321:0:9009:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787833753.017347:0:9009:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1787833753.365992:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833753.947035:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406034688:0@lo:41: 00000100:00100000:2.0:1787833753.947123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833753.947251:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406034688 00000100:00100000:1.0:1787833753.947259:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406034688 00000100:00100000:1.0:1787833753.947314:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787833753.947323:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406034688:12345-0@lo:41: 00000004:00000024:1.0:1787833753.947365:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787833753.947410:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406034688:12345-0@lo:41: Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833753.947418:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787833753.947502:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406034688:0@lo:41: 00010000:00010000:3.0:1787833754.402879:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833755.416027:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833755.477998:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406034816:0@lo:41: 00000100:00100000:2.0:1787833755.478084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833755.478211:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406034816 00000100:00100000:1.0:1787833755.478220:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406034816 00000100:00100000:1.0:1787833755.478283:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787833755.478292:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406034816:12345-0@lo:41: 00000004:00000024:1.0:1787833755.478346:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787833755.478396:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406034816:12345-0@lo:41: Request processed in 105us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833755.478403:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787833755.478555:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406034816:0@lo:41: 00010000:00010000:1.0:1787833756.437992:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833757.014938:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406034944:0@lo:400: 00000100:00100000:3.0:1787833757.015015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833757.015073:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406035456:0@lo:400: 00000100:00100000:3.0:1787833757.015102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833757.015123:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406035968:0@lo:400: 00000100:00100000:3.0:1787833757.015146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833757.015171:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787833757.015190:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406035072:0@lo:400: 00000100:00100000:3.0:1787833757.015357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833757.015382:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406035584:0@lo:400: 00000100:00100000:3.0:1787833757.015407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833757.015441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406035456 00000100:00100000:3.0:1787833757.015448:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406035456 00000100:00100000:3.0:1787833757.015493:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787833757.015502:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406035456:12345-0@lo:400: 00000100:00100000:3.0:1787833757.015560:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406035456:12345-0@lo:400: Request processed in 59us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833757.015567:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787833757.015591:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406035072 00000100:00100000:3.0:1787833757.015594:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406035072 00000100:00100000:3.0:1787833757.015615:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406035584 00000100:00100000:3.0:1787833757.015633:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406035584 00000100:00100000:3.0:1787833757.015660:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833757.015666:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406035072:12345-0@lo:400: 00000100:00100000:3.0:1787833757.015700:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406035072:12345-0@lo:400: Request processed in 34us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833757.015705:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833757.015716:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787833757.015723:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406035584:12345-0@lo:400: 00000100:00100000:3.0:1787833757.015745:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406035584:12345-0@lo:400: Request processed in 23us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833757.015777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787833757.015795:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787833757.015821:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8ed00 x1874679406035072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833757.015834:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406035072:0@lo:400: 00010000:00080000:3.0:1787833757.015844:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8c3c0 x1874679406035584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833757.015852:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406035584:0@lo:400: 00000100:00100000:3.0:1787833757.015861:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406035456:0@lo:400: 00000100:00100000:1.0:1787833757.016059:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406035968 00000100:00100000:1.0:1787833757.016064:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406035968 00000100:00100000:1.0:1787833757.016098:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833757.016105:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406035968:12345-0@lo:400: 00000100:00100000:1.0:1787833757.016142:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406035968:12345-0@lo:400: Request processed in 38us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833757.016148:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833757.016402:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406034944 00000100:00100000:0.0:1787833757.016407:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406034944 00000100:00100000:0.0:1787833757.016437:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787833757.016453:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3638:x1874679406034944:12345-0@lo:400: 00000100:00100000:0.0:1787833757.016488:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3638:x1874679406034944:12345-0@lo:400: Request processed in 36us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833757.016494:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787833757.016611:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406036096:0@lo:13: 00000100:00100000:2.0:1787833757.016658:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833757.016701:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406035200:0@lo:400: 00000100:00100000:2.0:1787833757.016743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833757.016787:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406035712:0@lo:400: 00000100:00100000:2.0:1787833757.016808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833757.016823:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787833757.016829:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406035328:0@lo:400: 00000100:00100000:2.0:1787833757.016850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833757.016863:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406035840:0@lo:400: 00000100:00100000:2.0:1787833757.016880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833757.016920:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406035712 00000100:00100000:2.0:1787833757.016924:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406035712 00000100:00100000:2.0:1787833757.016945:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406035328 00000100:00100000:2.0:1787833757.016948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406035328 00000100:00100000:2.0:1787833757.016961:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787833757.016967:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406035712:12345-0@lo:400: 00000100:00100000:2.0:1787833757.017001:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406035712:12345-0@lo:400: Request processed in 34us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833757.017007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787833757.017019:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787833757.017024:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406035328:12345-0@lo:400: 00000100:00100000:2.0:1787833757.017050:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406035328:12345-0@lo:400: Request processed in 26us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833757.017055:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787833757.017072:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406035200 00000100:00100000:2.0:1787833757.017075:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406035200 00000100:00100000:2.0:1787833757.017094:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787833757.017100:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406035200:12345-0@lo:400: 00000100:00100000:3.0:1787833757.018478:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406035840 00000100:00100000:3.0:1787833757.018490:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406035840 00000100:00100000:3.0:1787833757.018563:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833757.018572:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406035840:12345-0@lo:400: 00000100:00100000:3.0:1787833757.018654:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406035840:12345-0@lo:400: Request processed in 83us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833757.018678:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787833757.018705:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787833757.018711:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833757.018772:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406034944:0@lo:400: 00010000:00080000:3.0:1787833757.018791:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df621338b40 x1874679406035968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833757.018802:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406035968:0@lo:400: 00000100:00100000:0.0:1787833757.018915:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406036096 00000100:00100000:0.0:1787833757.018920:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406036096 00000100:00100000:0.0:1787833757.018949:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833757.018956:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406036096:12345-0@lo:13: 00002000:00000024:0.0:1787833757.018977:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833757.019017:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406036096:12345-0@lo:13: Request processed in 63us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833757.019024:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787833757.019057:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df63c45b840 x1874679406036096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833757.019074:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406036096:0@lo:13: 00000100:00100000:3.0:1787833757.020128:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833757.020146:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406036224:0@lo:13: 00010000:00080000:0.0:1787833757.020383:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8fc00 x1874679406035328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833757.020396:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406035328:0@lo:400: 00010000:00080000:0.0:1787833757.020407:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8f840 x1874679406035840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833757.020415:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406035840:0@lo:400: 00010000:00080000:0.0:1787833757.020430:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8e1c0 x1874679406035712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833757.020439:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406035712:0@lo:400: 00000100:00100000:3.0:1787833757.021711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833757.023162:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406036224 00000100:00100000:2.0:1787833757.023380:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406035200:12345-0@lo:400: Request processed in 6275us (6631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833757.023394:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787833757.023469:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406035200:0@lo:400: 00000100:00100000:1.0:1787833757.023521:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406036224 00000100:00100000:1.0:1787833757.023575:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787833757.023585:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406036224:12345-0@lo:13: 00002000:00000024:1.0:1787833757.023611:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833757.023684:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406036224:12345-0@lo:13: Request processed in 101us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833757.023690:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787833757.029581:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6213383c0 x1874679406036224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833757.029610:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406036224:0@lo:13: 00010000:00010000:1.0:1787833757.462980:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833758.486041:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833759.068564:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833759.068592:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c459e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406036352:0@lo:41: 00000100:00100000:1.0:1787833759.068674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833759.068899:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406036352 00000100:00100000:2.0:1787833759.068907:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406036352 00000100:00100000:2.0:1787833759.068958:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787833759.068966:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c458b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406036352:12345-0@lo:41: 00000004:00000024:2.0:1787833759.068997:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787833759.069056:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c458b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406036352:12345-0@lo:41: Request processed in 90us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833759.069063:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787833759.069198:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c459e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406036352:0@lo:41: 00010000:00010000:3.0:1787833759.512268:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833760.533963:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833760.603217:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406036480:0@lo:41: 00000100:00100000:2.0:1787833760.603314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833760.603400:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406036480 00000100:00100000:2.0:1787833760.603408:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406036480 00000100:00100000:2.0:1787833760.603473:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787833760.603481:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406036480:12345-0@lo:41: 00000004:00000024:2.0:1787833760.603517:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787833760.603564:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406036480:12345-0@lo:41: Request processed in 82us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833760.603571:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787833760.603631:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406036480:0@lo:41: 00010000:00010000:0.0:1787833761.558254:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833762.135500:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406036608:0@lo:13: 00000100:00100000:0.0:1787833762.135575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833762.136073:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406036608 00000100:00100000:1.0:1787833762.136081:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406036608 00000100:00100000:1.0:1787833762.136136:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787833762.136159:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406036608:12345-0@lo:13: 00002000:00000024:1.0:1787833762.136189:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833762.136244:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406036608:12345-0@lo:13: Request processed in 101us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833762.136268:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787833762.136298:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833762.136308:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406036736:0@lo:13: 00000100:00100000:1.0:1787833762.136337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787833762.136368:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833762.136380:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406036736 00000100:00100000:1.0:1787833762.136383:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406036736 00000100:00100000:1.0:1787833762.136407:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787833762.136412:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c4583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406036736:12345-0@lo:13: 00002000:00000024:1.0:1787833762.136423:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833762.136453:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c4583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406036736:12345-0@lo:13: Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833762.136459:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787833762.136472:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787833762.136495:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df63c45a1c0 x1874679406036736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833762.136513:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406036736:0@lo:13: 00010000:00080000:1.0:1787833762.136540:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df621338b40 x1874679406036608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833762.136550:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406036608:0@lo:13: 00000100:00100000:3.0:1787833762.136866:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406036992:0@lo:400: 00000100:00100000:3.0:1787833762.136903:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833762.136926:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406037504:0@lo:400: 00000100:00100000:3.0:1787833762.136948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833762.136966:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787833762.136971:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406037120:0@lo:400: 00000100:00100000:3.0:1787833762.136995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833762.137012:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406037632:0@lo:400: 00000100:00100000:3.0:1787833762.137031:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833762.137067:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406036992 00000100:00100000:3.0:1787833762.137072:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406036992 00000100:00100000:3.0:1787833762.137098:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406037504 00000100:00100000:3.0:1787833762.137101:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406037504 00000100:00100000:3.0:1787833762.137117:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406037632 00000100:00100000:3.0:1787833762.137119:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406037632 00000100:00100000:3.0:1787833762.137158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833762.137165:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406036992:12345-0@lo:400: 00000100:00100000:3.0:1787833762.137208:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406036992:12345-0@lo:400: Request processed in 43us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833762.137214:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833762.137229:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833762.137235:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406037504:12345-0@lo:400: 00000100:00100000:3.0:1787833762.137264:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406037504:12345-0@lo:400: Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833762.137270:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833762.137281:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787833762.137287:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406037632:12345-0@lo:400: 00000100:00100000:3.0:1787833762.137326:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406037632:12345-0@lo:400: Request processed in 40us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833762.137331:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787833762.137354:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406037120 00000100:00100000:3.0:1787833762.137358:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406037120 00000100:00100000:3.0:1787833762.137391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787833762.137397:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406037120:12345-0@lo:400: 00000100:00100000:3.0:1787833762.137430:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406037120:12345-0@lo:400: Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833762.137435:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787833762.137468:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406037120:0@lo:400: 00010000:00080000:3.0:1787833762.137478:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8e580 x1874679406037632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833762.137487:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406037632:0@lo:400: 00010000:00080000:3.0:1787833762.137505:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8fc00 x1874679406036992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833762.137513:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406036992:0@lo:400: 00010000:00080000:3.0:1787833762.137522:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8ed00 x1874679406037504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833762.137528:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406037504:0@lo:400: 00000100:00100000:0.0:1787833762.138170:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406037248:0@lo:400: 00000100:00100000:0.0:1787833762.138214:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833762.138251:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787833762.138257:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406036864:0@lo:400: 00000100:00100000:0.0:1787833762.138284:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833762.138322:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406037376:0@lo:400: 00000100:00100000:0.0:1787833762.138364:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833762.138395:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406036864 00000100:00100000:0.0:1787833762.138400:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406036864 00000100:00100000:0.0:1787833762.138434:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787833762.138440:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3640:x1874679406036864:12345-0@lo:400: 00000100:00100000:0.0:1787833762.138483:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3640:x1874679406036864:12345-0@lo:400: Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833762.138490:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787833762.138516:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406037376 00000100:00100000:0.0:1787833762.138520:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406037376 00000100:00100000:0.0:1787833762.138540:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833762.138546:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406037376:12345-0@lo:400: 00000100:00100000:0.0:1787833762.138579:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406037376:12345-0@lo:400: Request processed in 33us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833762.138591:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833762.138622:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406036864:0@lo:400: 00000100:00100000:0.0:1787833762.138633:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406037376:0@lo:400: 00000100:00080000:1.0:1787833762.138791:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833762.138796:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833762.139975:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406037248 00000100:00100000:2.0:1787833762.139988:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406037248 00000100:00100000:2.0:1787833762.140041:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833762.140050:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406037248:12345-0@lo:400: 00000100:00100000:2.0:1787833762.140135:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406037248:12345-0@lo:400: Request processed in 87us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833762.140590:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787833762.141421:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8cf00 x1874679406037248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833762.141439:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406037248:0@lo:400: 00010000:00010000:3.0:1787833762.582982:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833763.607925:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833764.181952:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833764.181976:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406037760:0@lo:41: 00000100:00100000:1.0:1787833764.182050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833764.182374:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406037760 00000100:00100000:0.0:1787833764.182383:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406037760 00000100:00100000:0.0:1787833764.182442:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787833764.182454:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c458f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406037760:12345-0@lo:41: 00000004:00000024:0.0:1787833764.182500:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787833764.182556:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c458f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406037760:12345-0@lo:41: Request processed in 105us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833764.182563:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787833764.182626:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406037760:0@lo:41: 00010000:00010000:0.0:1787833764.635921:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787833764.779580:0:9509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787833764.779585:0:9509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787833764.779586:0:9509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787833764.780174:0:9509:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df63fb44000 00000020:01000004:0.0:1787833764.780190:0:9509:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787833764.780203:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787833764.780217:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df5027c4ed8) 00000020:00000080:0.0:1787833764.780234:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787833764.832127:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787833764.832198:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1787833764.903103:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787833764.903499:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787833764.903517:0:9509:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787833764.903529:0:9509:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x996d2fb20dc1d188 00000020:01000004:0.0:1787833764.903536:0:9509:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787833764.903559:0:9509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787833764.903563:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787833764.903570:0:9509:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787833764.903598:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787833764.903602:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787833764.930723:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787833764.930917:0:9509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.117@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787833764.930922:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787833764.930924:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787833764.930926:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833764.930927:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833764.930933:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833764.930935:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833764.930936:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833764.930938:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833764.930939:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833764.930941:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833764.930942:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833764.930945:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787833764.930947:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787833764.930948:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787833764.930949:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833764.930950:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833764.930951:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833764.930952:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833764.930953:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833764.930954:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833764.930955:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833764.930956:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833764.930957:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833764.930991:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787833764.931009:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406037888:0@lo:253: 00000100:00100000:2.0:1787833764.931085:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833764.931255:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e181900 going to sleep for 11 seconds 00000100:00100000:0.0:1787833764.931401:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406037888 00000100:00100000:0.0:1787833764.931408:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406037888 00000100:00100000:0.0:1787833764.931470:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787833764.931480:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:9509:x1874679406037888:12345-0@lo:253: 20000000:01000000:0.0:1787833764.931526:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787833764.931530:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787833764.931535:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787833764.931538:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787833764.931952:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833764.932098:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1787833764.932114:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787833764.932213:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1787833764.932221:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787833764.932234:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1787833764.932335:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1787833764.932429:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1787833764.932445:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:0.0:1787833764.932447:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:0.0:1787833764.932464:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1787833764.932469:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787833764.932480:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1787833764.932485:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:0.0:1787833764.932496:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1787833764.932512:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787833764.932526:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1787833764.932541:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1787833764.932607:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1787833764.932617:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:0.0:1787833764.932619:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:0.0:1787833764.932632:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1787833764.932636:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787833764.932650:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1787833764.932654:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:0.0:1787833764.932665:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1787833764.932670:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787833764.932681:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1787833764.932694:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1787833764.933087:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1787833764.933100:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:0.0:1787833764.933102:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:0.0:1787833764.933115:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1787833764.933368:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787833764.933390:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1787833764.933397:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:0.0:1787833764.933411:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1787833764.933418:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787833764.933432:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1787833764.933447:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1787833764.933461:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787833764.933464:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787833764.933468:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787833764.933528:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787833764.933531:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787833764.934048:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787833764.934078:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787833764.934091:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787833764.934444:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787833764.934474:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1787833764.934488:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1787833764.934497:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787833764.934499:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787833764.935456:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787833764.935490:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787833764.935506:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1787833764.935713:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1787833764.935736:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1787833764.935916:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1787833764.935932:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787833764.935935:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787833764.936442:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1787833764.936465:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1787833764.936480:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1787833764.936673:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1787833764.936693:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1787833764.936707:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1787833764.936716:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787833764.936724:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787833764.937114:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1787833764.937215:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1787833764.937231:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1787833764.937484:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1787833764.937506:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1787833764.937520:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1787833764.937529:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787833764.937531:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787833764.938082:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1787833764.938409:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1787833764.938433:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1787833764.938450:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:2.0:1787833764.938467:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787833764.938489:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938507:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d07e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938514:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d0a8 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938521:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d0e7 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938526:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d103 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938532:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d126 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938538:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d149 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938545:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d173 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938563:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938608:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d173 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938626:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d173 expref: 21 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.938644:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038016:0@lo:104: 00000100:00100000:2.0:1787833764.938733:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833764.938909:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d149 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.938917:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d149 expref: 21 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.938925:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038144:0@lo:104: 00000100:00100000:2.0:1787833764.938947:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833764.939152:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d126 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.939161:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d126 expref: 21 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.939170:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c23480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038272:0@lo:104: 00000100:00100000:2.0:1787833764.939193:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833764.939433:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d103 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.939452:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d103 expref: 21 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.939460:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621290000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038400:0@lo:104: 00000100:00100000:2.0:1787833764.939484:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833764.939509:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406038016 00000100:00100000:1.0:1787833764.939516:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406038016 00000100:00100000:1.0:1787833764.939554:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406038144 00000100:00100000:1.0:1787833764.939556:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406038144 00000100:00100000:1.0:1787833764.939565:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406038272 00000100:00100000:1.0:1787833764.939566:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406038272 00000100:00100000:1.0:1787833764.939580:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833764.939589:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6506:x1874679406038016:12345-0@lo:104: 00010000:00010000:1.0:1787833764.939601:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.939706:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833764.939713:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6506:x1874679406038016:12345-0@lo:104: Request processed in 125us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833764.939720:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833764.939740:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787833764.939747:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c21680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6506:x1874679406038144:12345-0@lo:104: 00010000:00010000:1.0:1787833764.939776:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.939929:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d0e7 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.939938:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0e7 expref: 21 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.939948:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038528:0@lo:104: 00000100:00100000:2.0:1787833764.939987:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833764.940008:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d0a8 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.940016:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0a8 expref: 21 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.940024:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff0780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038656:0@lo:104: 00000100:00100000:2.0:1787833764.940049:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833764.940065:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d07e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.940073:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d07e expref: 21 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.940081:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff30c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038784:0@lo:104: 00000100:00100000:2.0:1787833764.940108:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adb240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833764.940141:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038016:0@lo:104: 00000100:00100000:2.0:1787833764.940150:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038144:0@lo:104: 00000100:00100000:0.0:1787833764.940341:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787833764.940361:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833764.940375:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787833764.940379:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1787833764.940588:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406038400 00000100:00100000:2.0:1787833764.940594:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406038400 00000100:00100000:2.0:1787833764.940624:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787833764.940629:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406038528 00000100:00100000:2.0:1787833764.940632:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406038528 00000100:00100000:2.0:1787833764.940640:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787833764.940644:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406038656 00000100:00100000:2.0:1787833764.940646:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406038656 00000100:00100000:2.0:1787833764.940655:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787833764.940658:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406038784 00000100:00100000:2.0:1787833764.940661:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406038784 00000100:00100000:0.0:1787833764.940787:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787833764.940797:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+8:6506:x1874679406038272:12345-0@lo:104: 00010000:00010000:0.0:1787833764.940810:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.940916:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c23480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038272:0@lo:104: 00010000:00010000:3.0:1787833764.940975:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787833764.940983:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.940991:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833764.940995:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941003:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833764.941011:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833764.941016:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833764.941055:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941061:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833764.941079:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941099:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d17a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941111:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833764.941115:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941220:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6421c9600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833764.941224:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941231:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833764.941237:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833764.941242:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833764.941283:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941290:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833764.941307:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941315:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6421c9600/0x996d2fb20dc1d149 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941327:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833764.941336:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941342:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833764.941345:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941351:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833764.941357:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833764.941362:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833764.941375:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941381:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833764.941386:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941392:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600030800/0x996d2fb20dc1d126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d12d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941403:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833764.941405:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833764.941407:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833764.941421:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406038912:0@lo:103: 00000100:00100000:3.0:1787833764.941458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.941505:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406039040:0@lo:103: 00000100:00100000:3.0:1787833764.941537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.941557:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833764.941562:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406039168:0@lo:103: 00000100:00100000:3.0:1787833764.941580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.941608:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406038912 00000100:00100000:3.0:1787833764.941613:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406038912 00010000:00010000:3.0:1787833764.941633:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d173 expref: 22 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.941655:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406039040 00000100:00100000:3.0:1787833764.941658:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406039040 00010000:00010000:3.0:1787833764.941685:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d149 expref: 23 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.941697:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406039168 00000100:00100000:3.0:1787833764.941699:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406039168 00010000:00010000:3.0:1787833764.941709:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d126 expref: 24 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.941720:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787833764.941726:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406038912:12345-0@lo:103: 00010000:00010000:3.0:1787833764.941737:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833764.941742:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d173 expref: 24 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941776:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d173 expref: 24 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941791:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d17a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d173 expref: 24 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941814:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833764.941845:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3641:x1874679406038912:12345-0@lo:103: Request processed in 119us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833764.941852:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787833764.941870:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787833764.941876:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:3638:x1874679406039040:12345-0@lo:103: 00010000:00010000:3.0:1787833764.941883:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833764.941887:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d149 expref: 22 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941895:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d149 expref: 22 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941905:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6013fd800/0x996d2fb20dc1d150 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d149 expref: 22 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941914:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833764.941940:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3638:x1874679406039040:12345-0@lo:103: Request processed in 64us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833764.941947:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787833764.941958:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787833764.941964:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3638:x1874679406039168:12345-0@lo:103: 00010000:00010000:3.0:1787833764.941972:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833764.941976:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d126 expref: 20 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.941985:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d126 expref: 20 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.942001:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6421c8600/0x996d2fb20dc1d12d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d126 expref: 20 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.942010:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833764.942032:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3638:x1874679406039168:12345-0@lo:103: Request processed in 69us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833764.942039:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787833764.942073:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406038912:0@lo:103: 00000100:00100000:3.0:1787833764.942098:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406039168:0@lo:103: 00000100:00100000:3.0:1787833764.942105:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406039040:0@lo:103: 00010000:00010000:1.0:1787833764.942453:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787833764.942463:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c21680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+8:6506:x1874679406038144:12345-0@lo:104: Request processed in 2715us (3513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833764.942471:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787833764.942494:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787833764.942503:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+7:6506:x1874679406038400:12345-0@lo:104: 00010000:00010000:1.0:1787833764.942514:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942587:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833764.942592:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+7:6506:x1874679406038400:12345-0@lo:104: Request processed in 92us (3108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833764.942598:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787833764.942612:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787833764.942619:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:6506:x1874679406038528:12345-0@lo:104: 00010000:00010000:1.0:1787833764.942626:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942654:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787833764.942659:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:6506:x1874679406038528:12345-0@lo:104: Request processed in 41us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833764.942665:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787833764.942676:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787833764.942682:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6506:x1874679406038656:12345-0@lo:104: 00010000:00010000:1.0:1787833764.942704:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942730:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787833764.942735:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:6506:x1874679406038656:12345-0@lo:104: Request processed in 54us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833764.942739:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787833764.942769:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787833764.942776:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6506:x1874679406038784:12345-0@lo:104: 00010000:00010000:1.0:1787833764.942784:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942816:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787833764.942821:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6506:x1874679406038784:12345-0@lo:104: Request processed in 46us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833764.942826:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787833764.942845:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787833764.942850:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942858:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833764.942862:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942871:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833764.942877:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833764.942883:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833764.942912:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942918:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833764.942930:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942936:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d10a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942957:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787833764.942960:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942966:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fa00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833764.942969:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.942976:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833764.942982:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833764.942987:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833764.943000:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.943006:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833764.943011:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.943016:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d0e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0ee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.943023:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787833764.943026:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.943042:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833764.943044:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.943051:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833764.943056:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833764.943060:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833764.943073:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.943079:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833764.943089:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.943095:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d0a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0af expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.943104:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833764.943107:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.943113:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833764.943115:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.943245:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c459a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406039296:0@lo:103: 00000100:00100000:3.0:1787833764.943307:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.943339:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833764.943345:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406039424:0@lo:103: 00000100:00100000:3.0:1787833764.943365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.943384:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833764.943392:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406039552:0@lo:103: 00000100:00100000:3.0:1787833764.943413:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.943438:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406039296 00000100:00100000:3.0:1787833764.943444:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406039296 00010000:00010000:3.0:1787833764.943470:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d103 expref: 19 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.943490:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406039424 00000100:00100000:3.0:1787833764.943493:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406039424 00010000:00010000:3.0:1787833764.943503:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0e7 expref: 20 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.943532:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406039552 00000100:00100000:3.0:1787833764.943535:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406039552 00010000:00010000:3.0:1787833764.943545:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0a8 expref: 21 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.943557:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787833764.943563:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e165c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3640:x1874679406039296:12345-0@lo:103: 00010000:00010000:3.0:1787833764.943573:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833764.943577:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d103 expref: 21 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.943587:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d103 expref: 21 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.943602:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833764.943629:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e165c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3640:x1874679406039296:12345-0@lo:103: Request processed in 66us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833764.943636:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787833764.943672:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787833764.943678:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3640:x1874679406039424:12345-0@lo:103: 00010000:00010000:3.0:1787833764.943685:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833764.943690:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0e7 expref: 20 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.943699:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0e7 expref: 20 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.943707:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833764.943734:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3640:x1874679406039424:12345-0@lo:103: Request processed in 56us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833764.943740:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787833764.943770:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787833764.943776:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3639:x1874679406039552:12345-0@lo:103: 00010000:00010000:3.0:1787833764.943783:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833764.943788:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0a8 expref: 19 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.943798:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0a8 expref: 19 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.943806:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833764.943829:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3639:x1874679406039552:12345-0@lo:103: Request processed in 54us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833764.943835:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787833764.943868:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406039552:0@lo:103: 00000100:00100000:3.0:1787833764.943896:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406039424:0@lo:103: 00000100:00100000:3.0:1787833764.943904:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c459a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406039296:0@lo:103: 00010000:00010000:3.0:1787833764.943917:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833764.943946:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6421c8c00/0x996d2fb20dc1d10a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d103 expref: 18 pid: 6507 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.943957:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621290000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038400:0@lo:104: 00010000:00010000:3.0:1787833764.943966:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d0ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d0e7 expref: 17 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.943974:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038528:0@lo:104: 00010000:00010000:3.0:1787833764.943990:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d0af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d0a8 expref: 16 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.943999:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff0780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038656:0@lo:104: 00000100:00100000:3.0:1787833764.944006:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff30c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6506:1874679406038784:0@lo:104: 00010000:00010000:3.0:1787833764.944035:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.944292:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833764.944429:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833764.944437:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833764.944442:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833764.944476:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.944482:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833764.944492:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.944499:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d07e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d085 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833764.944514:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833764.944516:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833764.944518:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833764.945229:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c459680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406039680:0@lo:103: 00000100:00100000:3.0:1787833764.945418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833764.945631:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787833764.945642:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6506:x1874679406038272:12345-0@lo:104: Request processed in 4845us (6445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833764.945652:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787833764.945808:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833764.945935:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406039680 00000100:00100000:2.0:1787833764.945943:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406039680 00010000:00010000:2.0:1787833764.945976:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d07e expref: 16 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.946039:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787833764.946048:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:3639:x1874679406039680:12345-0@lo:103: 00010000:00010000:2.0:1787833764.946063:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833764.946067:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d07e expref: 16 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946078:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d07e expref: 16 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946113:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6421c9400/0x996d2fb20dc1d085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d07e expref: 16 pid: 6506 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946202:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946210:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946225:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946233:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946239:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946314:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946321:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833764.946325:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946333:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946356:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.946378:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833764.946472:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833764.946481:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833764.946497:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4e200/0x996d2fb20dc1d18f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787833764.946510:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787833764.947375:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3639:x1874679406039680:12345-0@lo:103: Request processed in 1324us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833764.947386:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787833764.948675:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:9509:x1874679406037888:12345-0@lo:253: Request processed in 17187us (17581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833764.948689:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787833764.948906:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c459680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406039680:0@lo:103: 00000100:00100000:2.0:1787833764.949223:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406037888:0@lo:253: 10000000:01000000:2.0:1787833764.949238:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787833764.949242:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787833764.949243:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787833764.949244:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833764.949327:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787833764.949328:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833764.949330:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833764.949331:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833764.949333:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787833764.949335:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833764.949337:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787833764.949361:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df63fb44000 from lustre-OST0001 10000000:01000000:2.0:1787833764.949395:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787833764.949398:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787833764.949407:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df60ec73490 local copy 10000000:01000000:2.0:1787833764.949411:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787833764.949448:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.949459:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.949468:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833764.949486:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406039808:0@lo:101: 00000100:00100000:2.0:1787833764.949542:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833764.949623:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833764.949665:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406039808 00000100:00100000:0.0:1787833764.949673:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406039808 00000100:00100000:0.0:1787833764.949779:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787833764.949788:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+14:9509:x1874679406039808:12345-0@lo:101: 00010000:00010000:0.0:1787833764.949801:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833764.949815:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030200/0x996d2fb20dc1d19d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d196 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833764.949838:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030200/0x996d2fb20dc1d19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d196 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833764.949848:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030200/0x996d2fb20dc1d19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d196 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833764.949856:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030200, rc 0) 00000100:00100000:0.0:1787833764.949897:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406039808:12345-0@lo:101: Request processed in 111us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833764.949904:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787833764.949994:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406039808:0@lo:101: 00010000:00010000:3.0:1787833764.950011:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.950018:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.950143:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406039936:0@lo:501: 00000100:00100000:3.0:1787833764.950180:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.950541:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833764.950604:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406039936 00000100:00100000:2.0:1787833764.950610:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406039936 00000100:00100000:2.0:1787833764.950641:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787833764.950648:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406039936:12345-0@lo:501: 00000100:00100000:2.0:1787833764.950722:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406039936:12345-0@lo:501: Request processed in 74us (541us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787833764.950729:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787833764.950853:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406039936:0@lo:501: 10000000:01000000:3.0:1787833764.950867:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787833764.950887:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787833764.950894:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.950915:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.950924:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.950947:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787833764.950971:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df63fb44000 10000000:01000000:3.0:1787833764.950976:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787833764.950981:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787833764.950983:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787833764.950987:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787833764.950990:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787833764.951010:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.951016:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.951024:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.951036:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040064:0@lo:101: 00000100:00100000:3.0:1787833764.951063:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.951081:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833764.951738:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406040064 00000100:00100000:2.0:1787833764.951745:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406040064 00000100:00100000:2.0:1787833764.951816:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787833764.951823:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040064:12345-0@lo:101: 00010000:00010000:2.0:1787833764.951834:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833764.951847:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d1a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.951870:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d1a4 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.951880:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d1a4 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.951887:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f400, rc 0) 00000100:00100000:2.0:1787833764.951929:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406040064:12345-0@lo:101: Request processed in 107us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833764.951935:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00010000:2.0:1787833764.951965:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833764.951979:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.951986:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833764.951990:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.951998:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833764.952005:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833764.952010:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833764.952033:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.952040:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833764.952060:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.952067:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1d196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x996d2fb20dc1d19d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.952078:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833764.952080:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833764.952082:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833764.952089:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833764.952101:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406040192:0@lo:103: 00000100:00100000:2.0:1787833764.952479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833764.952526:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406040192 00000100:00100000:2.0:1787833764.952539:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406040192 00000100:00100000:2.0:1787833764.952578:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787833764.952584:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:3641:x1874679406040192:12345-0@lo:103: 00010000:00010000:2.0:1787833764.952594:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833764.952607:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600030200/0x996d2fb20dc1d19d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d196 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833764.952619:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833764.952647:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3641:x1874679406040192:12345-0@lo:103: Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833764.952654:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787833764.952689:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406040192:0@lo:103: 00000100:00100000:3.0:1787833764.952975:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040064:0@lo:101: 00010000:00010000:3.0:1787833764.952993:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833764.953014:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833764.953106:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040320:0@lo:501: 00000100:00100000:3.0:1787833764.953151:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.953175:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833764.953522:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406040320 00000100:00100000:0.0:1787833764.953528:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406040320 00000100:00100000:0.0:1787833764.953563:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787833764.953577:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040320:12345-0@lo:501: 00000100:00100000:0.0:1787833764.953698:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040320:12345-0@lo:501: Request processed in 121us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833764.953706:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787833764.953844:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040320:0@lo:501: 00000100:00100000:3.0:1787833764.953872:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040448:0@lo:503: 00000100:00100000:3.0:1787833764.953913:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.953935:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833764.954017:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406040448 00000100:00100000:2.0:1787833764.954022:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406040448 00000100:00100000:2.0:1787833764.954045:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787833764.954052:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040448:12345-0@lo:503: 00000100:00100000:2.0:1787833764.954147:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040448:12345-0@lo:503: Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833764.954154:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787833764.954308:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040448:0@lo:503: 00000040:00080000:3.0:1787833764.954585:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787833764.954658:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040576:0@lo:502: 00000100:00100000:3.0:1787833764.954699:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.954727:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833764.954843:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406040576 00000100:00100000:2.0:1787833764.954847:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406040576 00000100:00100000:2.0:1787833764.954869:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787833764.954876:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040576:12345-0@lo:502: 00000100:00100000:2.0:1787833764.954962:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040576:12345-0@lo:502: Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833764.954970:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787833764.955053:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040576:0@lo:502: 00000040:00080000:3.0:1787833764.955281:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787833764.955311:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787833764.955326:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787833764.955338:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787833764.955349:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787833764.955361:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787833764.955380:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040704:0@lo:502: 00000100:00100000:3.0:1787833764.955420:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.955457:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833764.955588:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406040704 00000100:00100000:2.0:1787833764.955598:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406040704 00000100:00100000:2.0:1787833764.955619:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787833764.955625:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040704:12345-0@lo:502: 00000100:00100000:2.0:1787833764.955703:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040704:12345-0@lo:502: Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833764.955710:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787833764.959746:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040704:0@lo:502: 00000040:00080000:3.0:1787833764.959897:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787833764.959913:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1787833764.960570:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787833764.960583:0:9521:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787833764.960592:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833764.960594:0:9521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787833764.960601:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833764.960640:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df5039bced8) 00000020:00000080:3.0:1787833764.960671:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787833764.960678:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787833764.960788:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df63fb44000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787833764.960799:0:9521:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787833764.960806:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x996d2fb20dc1d1b9 00010000:00010000:3.0:1787833764.968441:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1787833764.969433:0:9521:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787833764.973258:0:9521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787833764.973593:0:9521:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787833764.987601:0:9521:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1787833764.987932:0:9521:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1787833765.004329:0:9521:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787833765.010392:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787833765.010404:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833765.010411:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833765.010414:0:9521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787833765.010418:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833765.010422:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833765.010423:0:9521:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787833765.010427:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787833765.010428:0:9521:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787833765.010453:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833765.010456:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833765.010457:0:9521:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787833765.010460:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787833765.020428:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787833765.020483:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787833765.020522:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833765.020535:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833765.020564:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63fb44000 from 1 10000000:01000000:1.0:1787833765.020567:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833765.020608:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833765.020616:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833765.020626:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833765.020648:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c459680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040832:0@lo:101: 00000100:00100000:1.0:1787833765.021392:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833765.021440:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787833765.021977:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406040832 00000100:00100000:3.0:1787833765.021987:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406040832 00000100:00100000:3.0:1787833765.022041:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787833765.022050:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:9509:x1874679406040832:12345-0@lo:101: 00010000:00010000:3.0:1787833765.022064:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833765.022079:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d1c0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833765.022114:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d1c0 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833765.022124:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d1c0 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833765.022149:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247e00, rc 0) 00000100:00100000:3.0:1787833765.022200:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406040832:12345-0@lo:101: Request processed in 151us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.022206:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787833765.022568:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c459680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040832:0@lo:101: 00010000:00010000:1.0:1787833765.022588:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833765.022597:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833765.022741:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c459680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040960:0@lo:501: 00000100:00100000:1.0:1787833765.022841:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833765.022883:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787833765.024829:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406040960 00000100:00100000:3.0:1787833765.024842:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406040960 00000100:00100000:3.0:1787833765.024903:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787833765.024911:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406040960:12345-0@lo:501: 00000100:00100000:1.0:1787833765.025909:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406040960:12345-0@lo:501: Request processed in 993us (3063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833765.025921:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787833765.026066:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c459680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406040960:0@lo:501: 00000100:00100000:2.0:1787833765.026130:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041088:0@lo:503: 00000100:00100000:2.0:1787833765.026180:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.026221:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833765.026459:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406041088 00000100:00100000:3.0:1787833765.026465:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406041088 00000100:00100000:3.0:1787833765.026510:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787833765.026520:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406041088:12345-0@lo:503: 00000100:00100000:3.0:1787833765.026634:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406041088:12345-0@lo:503: Request processed in 115us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.026641:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787833765.028040:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041088:0@lo:503: 00000040:00080000:1.0:1787833765.028363:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787833765.028448:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041216:0@lo:502: 00000100:00100000:1.0:1787833765.028508:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833765.028551:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833765.028840:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406041216 00000100:00100000:2.0:1787833765.028847:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406041216 00000100:00100000:2.0:1787833765.028895:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787833765.028904:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406041216:12345-0@lo:502: 00000100:00100000:2.0:1787833765.029017:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406041216:12345-0@lo:502: Request processed in 114us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.029024:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787833765.035618:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041216:0@lo:502: 00000040:00080000:1.0:1787833765.035905:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787833765.035937:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787833765.035973:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041344:0@lo:502: 00000100:00100000:1.0:1787833765.036044:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833765.036082:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833765.036861:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406041344 00000100:00100000:2.0:1787833765.036870:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406041344 00000100:00100000:2.0:1787833765.037018:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787833765.037027:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406041344:12345-0@lo:502: 00000100:00100000:2.0:1787833765.037338:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406041344:12345-0@lo:502: Request processed in 312us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.037347:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787833765.041301:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041344:0@lo:502: 00000040:00080000:0.0:1787833765.041413:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787833765.041426:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787833765.051410:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833765.051424:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833765.051426:0:9525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787833765.051432:0:9525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df63fb44000 00000020:00000080:0.0:1787833765.051435:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787833765.051446:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833765.051449:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833765.051450:0:9525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787833765.051453:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787833765.051604:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787833765.051634:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833765.051656:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833765.051668:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833765.051944:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787833765.051948:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df63fb44000 10000000:01000000:1.0:1787833765.051951:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df63fb44000 10000000:01000000:1.0:1787833765.051956:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787833765.051961:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df63fb44000 from 1 10000000:01000000:1.0:1787833765.051964:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787833765.052002:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833765.052010:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833765.052030:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833765.052053:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041472:0@lo:101: 00000100:00100000:1.0:1787833765.052197:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833765.052241:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833765.052321:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406041472 00000100:00100000:3.0:1787833765.052328:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406041472 00000100:00100000:3.0:1787833765.052378:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787833765.052388:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9509:x1874679406041472:12345-0@lo:101: 00010000:00010000:3.0:1787833765.052401:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833765.052414:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d1ce expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833765.052437:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d1ce expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833765.052448:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d1ce expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833765.052463:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246400, rc 0) 00000100:00100000:3.0:1787833765.052513:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406041472:12345-0@lo:101: Request processed in 126us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.052520:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787833765.052643:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041472:0@lo:101: 00010000:00010000:1.0:1787833765.052657:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833765.052666:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833765.052965:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041600:0@lo:501: 00000100:00100000:1.0:1787833765.052996:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833765.053026:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833765.053115:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406041600 00000100:00100000:2.0:1787833765.053129:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406041600 00000100:00100000:2.0:1787833765.053164:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787833765.053172:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406041600:12345-0@lo:501: 00000100:00100000:2.0:1787833765.053296:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406041600:12345-0@lo:501: Request processed in 125us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.053304:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787833765.053626:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041600:0@lo:501: 00000100:00100000:1.0:1787833765.053660:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041728:0@lo:503: 00000100:00100000:1.0:1787833765.053881:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833765.053949:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833765.054338:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406041728 00000100:00100000:2.0:1787833765.054345:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406041728 00000100:00100000:2.0:1787833765.054398:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787833765.054407:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406041728:12345-0@lo:503: 00000100:00100000:2.0:1787833765.054525:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406041728:12345-0@lo:503: Request processed in 119us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.054533:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787833765.054655:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041728:0@lo:503: 00000040:00080000:1.0:1787833765.054959:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787833765.055048:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041856:0@lo:502: 00000100:00100000:1.0:1787833765.055093:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833765.055115:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833765.055534:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406041856 00000100:00100000:2.0:1787833765.055540:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406041856 00000100:00100000:2.0:1787833765.055606:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787833765.055621:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406041856:12345-0@lo:502: 00000100:00100000:2.0:1787833765.055747:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406041856:12345-0@lo:502: Request processed in 127us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.055773:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787833765.056289:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041856:0@lo:502: 00000040:00080000:1.0:1787833765.056525:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787833765.056559:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787833765.056571:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787833765.056584:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787833765.056596:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787833765.056607:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787833765.056618:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787833765.056629:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787833765.056640:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787833765.056653:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787833765.056666:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787833765.056677:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787833765.056703:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787833765.056718:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787833765.056733:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787833765.056796:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787833765.056812:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787833765.056823:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787833765.056835:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787833765.056848:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787833765.056859:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787833765.056870:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787833765.056882:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787833765.056894:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787833765.056907:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787833765.056920:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787833765.056933:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787833765.056946:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787833765.056958:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787833765.056969:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787833765.056981:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787833765.057016:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787833765.057032:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787833765.057043:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787833765.057054:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787833765.057063:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787833765.057074:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1787833765.057085:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787833765.057096:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1787833765.057109:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1787833765.059831:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1787833765.059888:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1787833765.059900:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1787833765.059911:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1787833765.059922:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1787833765.059933:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1787833765.059983:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041984:0@lo:502: 00000100:00100000:1.0:1787833765.060076:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833765.061351:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406041984 00000100:00100000:0.0:1787833765.061363:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406041984 00000100:00100000:0.0:1787833765.061411:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787833765.061419:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406041984:12345-0@lo:502: 00000100:00100000:0.0:1787833765.061582:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406041984:12345-0@lo:502: Request processed in 163us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833765.061589:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787833765.065086:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833765.065147:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406041984:0@lo:502: 00000040:00080000:1.0:1787833765.065280:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1787833765.065297:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1787833765.066159:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787833765.066177:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df5039b9a48) 00000020:00000080:3.0:1787833765.066205:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1787833765.066295:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df63fb44000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787833765.066299:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63fb44000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787833765.066302:0:9526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63fb44000 3 00010000:00080000:3.0:1787833765.066334:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df5039c4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1787833765.069033:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1787833765.069429:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787833765.069476:0:9526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787833765.069489:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x996d2fb20dc1d1e3 00000100:00080000:3.0:1787833765.069500:0:9526:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787833765.069507:0:9526:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df5039c4000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787833765.069543:0:9526:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a8c3c0 x1874679406042112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787833765.069574:0:9526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787833765.069678:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406042368:0@lo:400: 00000100:00100000:1.0:1787833765.069797:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406042112:0@lo:38: 00000100:00100000:1.0:1787833765.069864:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833765.070000:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833765.070021:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406042880:0@lo:400: 00000100:00100000:3.0:1787833765.070046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833765.070068:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787833765.070073:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406042496:0@lo:400: 00000100:00100000:3.0:1787833765.070111:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.070264:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406042240:0@lo:400: 00000100:00100000:2.0:1787833765.070311:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406042624:0@lo:400: 00000100:00100000:1.0:1787833765.070384:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406042368 00000100:00100000:1.0:1787833765.070394:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406042368 00000100:00100000:1.0:1787833765.070458:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787833765.070469:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406042368:12345-0@lo:400: 00000100:00100000:1.0:1787833765.070524:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406042368:12345-0@lo:400: Request processed in 56us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833765.070539:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787833765.070928:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406043008:0@lo:400: 00000100:00100000:3.0:1787833765.070957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833765.070991:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406042368:0@lo:400: 00000100:00100000:3.0:1787833765.071033:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406042112 00000100:00100000:3.0:1787833765.071037:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406042112 00000100:00100000:3.0:1787833765.071059:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406042496 00000100:00100000:3.0:1787833765.071062:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406042496 00000100:00100000:3.0:1787833765.071081:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787833765.071087:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406042496:12345-0@lo:400: 00000100:00100000:3.0:1787833765.071138:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406042496:12345-0@lo:400: Request processed in 51us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.071145:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787833765.071161:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833765.071165:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406042112:12345-0@lo:38: 00010000:00080000:3.0:1787833765.071189:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1787833765.071223:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x996d2fb20dc1d1ea 00000004:00100000:3.0:1787833765.071238:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787833765.071282:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833765.071321:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874679406042112:12345-0@lo:38: Request processed in 154us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.071328:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833765.071347:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406042880 00000100:00100000:3.0:1787833765.071350:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406042880 00000100:00100000:3.0:1787833765.071383:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406043008 00000100:00100000:3.0:1787833765.071386:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406043008 00000100:00100000:3.0:1787833765.071405:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833765.071420:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406042880:12345-0@lo:400: 00000100:00100000:3.0:1787833765.071452:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406042880:12345-0@lo:400: Request processed in 33us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.071458:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833765.071469:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787833765.071475:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406043008:12345-0@lo:400: 00000100:00100000:3.0:1787833765.071498:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406043008:12345-0@lo:400: Request processed in 23us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.071503:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787833765.071521:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833765.071557:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8c3c0 x1874679406042112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833765.071567:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787833765.071573:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787833765.071580:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787833765.071584:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787833765.071587:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787833765.071592:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406042112:0@lo:38: 00010000:00080000:3.0:1787833765.071619:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8e580 x1874679406042496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833765.071628:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406042496:0@lo:400: 00010000:00080000:3.0:1787833765.071636:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df621293c00 x1874679406043008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833765.071644:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406043008:0@lo:400: 00010000:00080000:3.0:1787833765.071652:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df621293480 x1874679406042880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833765.071667:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406042880:0@lo:400: 00000100:00100000:2.0:1787833765.071918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.071959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.071980:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406042752:0@lo:400: 00000100:00100000:2.0:1787833765.072009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.072033:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406042624 00000100:00100000:2.0:1787833765.072038:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406042624 00000100:00100000:2.0:1787833765.072066:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406042240 00000100:00100000:2.0:1787833765.072069:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406042240 00000100:00100000:2.0:1787833765.072079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406042752 00000100:00100000:2.0:1787833765.072081:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406042752 00000100:00100000:2.0:1787833765.072095:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787833765.072101:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406042624:12345-0@lo:400: 00000100:00100000:2.0:1787833765.072151:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406042624:12345-0@lo:400: Request processed in 50us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.072158:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787833765.072172:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787833765.072178:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406042240:12345-0@lo:400: 00000100:00100000:2.0:1787833765.072210:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406042240:12345-0@lo:400: Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.072217:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787833765.072237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787833765.072243:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406042752:12345-0@lo:400: 00000100:00100000:2.0:1787833765.072282:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406042752:12345-0@lo:400: Request processed in 29us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.072287:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787833765.072315:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8f480 x1874679406042624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833765.072324:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406042624:0@lo:400: 00010000:00080000:2.0:1787833765.072346:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8f840 x1874679406042240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833765.072354:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406042240:0@lo:400: 00010000:00080000:2.0:1787833765.072362:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df621292d00 x1874679406042752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833765.072369:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406042752:0@lo:400: 00000100:00080000:2.0:1787833765.072390:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833765.072394:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:3.0:1787833765.074357:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787833765.074376:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8df5039bb490) 00000020:00000080:3.0:1787833765.074407:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1787833765.074534:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df63fb44000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787833765.074540:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63fb44000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787833765.074544:0:9526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63fb44000 3 00010000:00080000:3.0:1787833765.074592:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df503db1800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.117@tcp at head 00000100:00100000:2.0:1787833765.075260:0:9527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff03c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1874679406043136:0@lo:901: 00000100:00100000:2.0:1787833765.075357:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.075394:0:9527:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605391240 going to sleep for 11 seconds 00000100:00100000:1.0:1787833765.075523:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406043136 00000100:00100000:1.0:1787833765.075532:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406043136 00000100:00100000:1.0:1787833765.075595:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787833765.075605:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1874679406043136:12345-0@lo:901: 00000100:00100000:1.0:1787833765.075709:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1874679406043136:12345-0@lo:901: Request processed in 105us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833765.075717:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787833765.078249:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787833765.078319:0:9527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff03c0 x1874679406043136/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787833781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833765.078336:0:9527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff03c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1874679406043136:0@lo:901: 00010000:00010000:3.0:1787833765.103163:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1787833765.103437:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787833765.103492:0:9526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787833765.103507:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x996d2fb20dc1d1f8 00000100:00080000:3.0:1787833765.103519:0:9526:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787833765.103524:0:9526:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8df503db1800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787833765.103559:0:9526:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50250ad00 x1874679406043264/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787833765.103591:0:9526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787833765.103730:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406043648:0@lo:400: 00000100:00100000:3.0:1787833765.103836:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833765.103870:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406044160:0@lo:400: 00000100:00100000:3.0:1787833765.103896:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833765.103918:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787833765.103924:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406043776:0@lo:400: 00000100:00100000:3.0:1787833765.103948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833765.103965:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406044288:0@lo:400: 00000100:00100000:3.0:1787833765.104003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833765.104043:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406043648 00000100:00100000:3.0:1787833765.104049:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406043648 00000100:00100000:3.0:1787833765.104108:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787833765.104117:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406043648:12345-0@lo:400: 00000100:00100000:3.0:1787833765.104175:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406043648:12345-0@lo:400: Request processed in 58us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.104182:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787833765.104205:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406044288 00000100:00100000:3.0:1787833765.104209:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406044288 00000100:00100000:3.0:1787833765.104237:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833765.104244:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406044288:12345-0@lo:400: 00000100:00100000:3.0:1787833765.104287:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406044288:12345-0@lo:400: Request processed in 43us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.104293:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787833765.104330:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8e580 x1874679406044288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833765.104344:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406044288:0@lo:400: 00000100:00100000:3.0:1787833765.104354:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406043648:0@lo:400: 00000100:00100000:0.0:1787833765.105431:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406043264:0@lo:38: 00000100:00100000:0.0:1787833765.105505:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.105708:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406043392:0@lo:400: 00000100:00100000:2.0:1787833765.105787:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.105813:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406043904:0@lo:400: 00000100:00100000:2.0:1787833765.105838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.105856:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406044416:0@lo:400: 00000100:00100000:2.0:1787833765.105878:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.105900:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787833765.105908:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406043520:0@lo:400: 00000100:00100000:2.0:1787833765.105929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.105940:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406044032:0@lo:400: 00000100:00100000:2.0:1787833765.105959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.105969:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406044544:0@lo:400: 00000100:00100000:2.0:1787833765.105985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.106011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406044160 00000100:00100000:2.0:1787833765.106018:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406044160 00000100:00100000:2.0:1787833765.106054:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406043776 00000100:00100000:2.0:1787833765.106056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406043776 00000100:00100000:2.0:1787833765.106068:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406043264 00000100:00100000:2.0:1787833765.106071:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406043264 00000100:00100000:2.0:1787833765.106080:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406043520 00000100:00100000:2.0:1787833765.106082:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406043520 00000100:00100000:2.0:1787833765.106092:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406044032 00000100:00100000:2.0:1787833765.106094:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406044032 00000100:00100000:2.0:1787833765.106103:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406044544 00000100:00100000:2.0:1787833765.106106:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406044544 00000100:00100000:2.0:1787833765.106118:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787833765.106125:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406044160:12345-0@lo:400: 00000100:00100000:2.0:1787833765.106179:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406044160:12345-0@lo:400: Request processed in 53us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.106194:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787833765.106212:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787833765.106218:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502513c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406043776:12345-0@lo:400: 00000100:00100000:2.0:1787833765.106248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502513c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406043776:12345-0@lo:400: Request processed in 30us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.106254:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787833765.106265:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787833765.106281:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406043520:12345-0@lo:400: 00000100:00100000:2.0:1787833765.106313:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406043520:12345-0@lo:400: Request processed in 43us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.106319:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787833765.106330:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787833765.106335:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406044032:12345-0@lo:400: 00000100:00100000:2.0:1787833765.106361:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406044032:12345-0@lo:400: Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.106366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787833765.106376:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787833765.106381:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406044544:12345-0@lo:400: 00000100:00100000:2.0:1787833765.106406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406044544:12345-0@lo:400: Request processed in 25us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.106412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787833765.106424:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787833765.106427:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874679406043264:12345-0@lo:38: 00010000:00080000:2.0:1787833765.106452:0:6514:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1787833765.106484:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x996d2fb20dc1d1ff 00000004:00100000:2.0:1787833765.106505:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787833765.106542:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8df5038ae800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833765.106588:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874679406043264:12345-0@lo:38: Request processed in 159us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.106595:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1787833765.109461:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:3.0:1787833765.110027:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406043904 00000100:00100000:3.0:1787833765.110038:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406043904 00000100:00100000:3.0:1787833765.110102:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787833765.110114:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406043904:12345-0@lo:400: 00000100:00100000:3.0:1787833765.110228:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406043904:12345-0@lo:400: Request processed in 117us (4388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.110249:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787833765.110286:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406043392 00000100:00100000:3.0:1787833765.110290:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406043392 00000100:00100000:3.0:1787833765.110320:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787833765.110327:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:3640:x1874679406043392:12345-0@lo:400: 00000100:00100000:3.0:1787833765.110362:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:3640:x1874679406043392:12345-0@lo:400: Request processed in 35us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.110369:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:0.0:1787833765.111868:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df621293480 x1874679406043776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833765.111887:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406043776:0@lo:400: 00010000:00080000:0.0:1787833765.111921:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8f480 x1874679406044160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833765.111930:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406044160:0@lo:400: 00000100:00100000:0.0:1787833765.111984:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406044416 00000100:00100000:0.0:1787833765.111991:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406044416 00000100:00100000:0.0:1787833765.112050:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787833765.112059:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406044416:12345-0@lo:400: 00000100:00100000:0.0:1787833765.112140:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406044416:12345-0@lo:400: Request processed in 81us (6260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833765.112146:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787833765.112650:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250ad00 x1874679406043264/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833765.112662:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787833765.112675:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787833765.112686:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787833765.112692:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787833765.112698:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df503db1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787833765.112707:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406043264:0@lo:38: 00000020:01000000:1.0:1787833765.112744:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1787833765.112810:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787833765.112832:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833765.112843:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787833765.112916:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787833765.112918:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787833765.112919:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833765.112925:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833765.112926:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833765.112927:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833765.112929:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787833765.112930:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833765.112931:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833765.112933:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833765.112934:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787833765.112938:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787833765.112940:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787833765.112941:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787833765.112942:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833765.112943:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833765.112944:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833765.112945:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833765.112946:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787833765.112947:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833765.112948:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833765.112948:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833765.112949:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:2.0:1787833765.112965:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502509680 x1874679406043520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833765.112976:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406043520:0@lo:400: 00010000:00080000:2.0:1787833765.112990:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8f840 x1874679406044032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833765.112998:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406044032:0@lo:400: 00010000:00080000:2.0:1787833765.113010:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8fc00 x1874679406044544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833765.113018:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406044544:0@lo:400: 00000100:00100000:2.0:1787833765.113028:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406043392:0@lo:400: 00000100:00100000:2.0:1787833765.113044:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406043904:0@lo:400: 00010000:00080000:2.0:1787833765.113057:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a8c3c0 x1874679406044416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833765.113064:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406044416:0@lo:400: 10000000:01000000:1.0:1787833765.113317:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787833765.113340:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406044672:0@lo:253: 00000100:00100000:1.0:1787833765.113397:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833765.113441:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787833765.114030:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406044672 00000100:00100000:3.0:1787833765.114040:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406044672 00000100:00100000:3.0:1787833765.114103:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787833765.114113:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406044672:12345-0@lo:253: 20000000:01000000:3.0:1787833765.114305:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787833765.114323:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787833765.127862:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787833765.127896:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787833765.128110:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787833765.128127:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787833765.128165:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128202:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d0f5 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128234:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d13b expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128243:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128297:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d13b expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128313:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d13b expref: 17 pid: 6508 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833765.128329:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff3c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406044800:0@lo:104: 00000100:00100000:2.0:1787833765.128397:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833765.128444:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d0f5 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128452:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0f5 expref: 17 pid: 6507 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833765.128460:0:6530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406044928:0@lo:104: 00000100:00100000:2.0:1787833765.128480:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.128500:0:6530:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605391780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833765.128519:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406044800 00000100:00100000:2.0:1787833765.128525:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406044800 00000100:00100000:2.0:1787833765.128561:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406044928 00000100:00100000:2.0:1787833765.128564:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406044928 00000100:00100000:2.0:1787833765.128579:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833765.128587:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6530:x1874679406044800:12345-0@lo:104: 00010000:00010000:2.0:1787833765.128606:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128657:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833765.128662:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:6530:x1874679406044800:12345-0@lo:104: Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.128669:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833765.128689:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833765.128695:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6530:x1874679406044928:12345-0@lo:104: 00010000:00010000:2.0:1787833765.128703:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128735:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787833765.128740:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:6530:x1874679406044928:12345-0@lo:104: Request processed in 46us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.128745:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787833765.128788:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787833765.128795:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128802:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6421c9800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833765.128805:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128813:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833765.128820:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833765.128831:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833765.128861:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128868:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833765.128884:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128906:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6421c9800/0x996d2fb20dc1d13b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128918:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833765.128921:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128927:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833765.128930:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128936:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833765.128941:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833765.128947:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833765.128960:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.128965:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787833765.130431:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9509:x1874679406044672:12345-0@lo:253: Request processed in 16314us (17028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833765.130445:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787833765.130594:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3f2e78c7-534c-47b7-a20f-32c44fb24136:9509:1874679406044672:0@lo:253: 10000000:01000000:1.0:1787833765.130610:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787833765.130613:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787833765.130615:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787833765.130616:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833765.130617:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833765.130619:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833765.130620:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833765.130621:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787833765.130623:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833765.130624:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833765.130626:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833765.130627:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787833765.130643:0:9509:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787833765.131295:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.131307:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1d0f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.131328:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833765.131330:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833765.131332:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833765.131341:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833765.131366:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406045056:0@lo:103: 00000100:00100000:2.0:1787833765.131413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.131455:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833765.131461:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406045184:0@lo:103: 00000100:00100000:2.0:1787833765.131500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833765.131540:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406045056 00000100:00100000:2.0:1787833765.131549:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406045056 00010000:00010000:2.0:1787833765.131586:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d13b expref: 17 pid: 6508 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833765.131614:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406045184 00000100:00100000:2.0:1787833765.131617:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406045184 00010000:00010000:2.0:1787833765.131629:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0f5 expref: 18 pid: 6507 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833765.131650:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833765.131659:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3638:x1874679406045056:12345-0@lo:103: 00010000:00010000:2.0:1787833765.131675:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833765.131681:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d13b expref: 18 pid: 6508 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.131705:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d13b expref: 18 pid: 6508 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.131729:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833765.131785:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3638:x1874679406045056:12345-0@lo:103: Request processed in 127us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.131793:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833765.131810:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833765.131816:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:3638:x1874679406045184:12345-0@lo:103: 00010000:00010000:2.0:1787833765.131825:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833765.131829:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0f5 expref: 17 pid: 6507 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.131839:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d0f5 expref: 17 pid: 6507 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.131850:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.131859:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787833765.131873:0:8457:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.020717501s 00010000:00010000:2.0:1787833765.131878:0:8457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.131886:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.134032:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.134063:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.134071:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833765.134076:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.134087:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.134102:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.134788:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833765.134875:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f41e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:3638:x1874679406045184:12345-0@lo:103: Request processed in 3045us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833765.134886:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833765.134972:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406045184:0@lo:103: 00000100:00100000:2.0:1787833765.134984:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406045056:0@lo:103: 00010000:00010000:2.0:1787833765.135023:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6421c8e00/0x996d2fb20dc1d142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d13b expref: 16 pid: 6508 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833765.135036:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff3c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406044800:0@lo:104: 00010000:00010000:2.0:1787833765.135045:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6421c9c00/0x996d2fb20dc1d0fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d0f5 expref: 15 pid: 6507 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833765.135053:0:6530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1874679406044928:0@lo:104: 00010000:00010000:2.0:1787833765.135075:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.135083:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.135089:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833765.135095:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d206 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787833765.141188:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787833765.146128:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787833765.146433:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787833765.146599:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787833765.146837:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787833765.147056:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787833765.149050:0:9509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787833765.167499:0:9509:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787833765.167510:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787833765.167548:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787833765.167590:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787833765.167610:0:9509:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787833765.167631:0:9509:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787833765.169525:0:9509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787833765.169770:0:9509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787833765.653981:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833765.719454:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833765.719479:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406045312:0@lo:41: 00000100:00100000:0.0:1787833765.719552:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833765.719635:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406045312 00000100:00100000:0.0:1787833765.719649:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406045312 00000100:00100000:0.0:1787833765.719695:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787833765.719704:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406045312:12345-0@lo:41: 00000004:00000024:0.0:1787833765.719736:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787833765.719815:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406045312:12345-0@lo:41: Request processed in 111us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833765.719823:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787833765.719871:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406045312:0@lo:41: 00000020:00000004:1.0:1787833766.306304:0:9582:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787833766.306554:0:9582:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787833766.678026:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833767.258150:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406045440:0@lo:13: 00000100:00100000:2.0:1787833767.258222:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833767.258353:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406045440 00000100:00100000:2.0:1787833767.258361:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406045440 00000100:00100000:2.0:1787833767.258426:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833767.258435:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406045440:12345-0@lo:13: 00002000:00000024:2.0:1787833767.258465:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833767.258508:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406045440:12345-0@lo:13: Request processed in 74us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833767.258515:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787833767.258534:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787833767.258568:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f403c0 x1874679406045440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833767.258586:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406045440:0@lo:13: 00000100:00100000:0.0:1787833767.259709:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833767.259726:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406045568:0@lo:13: 00000100:00100000:3.0:1787833767.262993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833767.263189:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406045568 00000100:00100000:1.0:1787833767.263198:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406045568 00000100:00100000:1.0:1787833767.263272:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787833767.263281:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406045568:12345-0@lo:13: 00002000:00000024:1.0:1787833767.263308:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833767.263359:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406045568:12345-0@lo:13: Request processed in 80us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833767.263366:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787833767.263530:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833767.263559:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a9a940 x1874679406045568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833767.263578:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406045568:0@lo:13: 00010000:00010000:2.0:1787833767.702009:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833768.730830:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833769.302793:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c458780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406045696:0@lo:41: 00000100:00100000:3.0:1787833769.305225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833769.305461:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406045696 00000100:00100000:2.0:1787833769.305471:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406045696 00000100:00100000:2.0:1787833769.305523:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787833769.305532:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406045696:12345-0@lo:41: 00000004:00000024:2.0:1787833769.305570:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787833769.305644:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406045696:12345-0@lo:41: Request processed in 113us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833769.305651:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787833769.306985:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c458780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406045696:0@lo:41: 00010000:00010000:2.0:1787833769.752377:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833770.326950:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406045952:0@lo:400: 00000100:00100000:3.0:1787833770.327024:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833770.327073:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406046464:0@lo:400: 00000100:00100000:1.0:1787833770.327347:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406045824:0@lo:400: 00000100:00100000:1.0:1787833770.331441:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833770.332158:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406045824 00000100:00100000:2.0:1787833770.332169:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406045824 00000100:00100000:1.0:1787833770.332341:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406046336:0@lo:400: 00000100:00100000:1.0:1787833770.332394:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833770.332424:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406046848:0@lo:400: 00000100:00100000:1.0:1787833770.332451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833770.332575:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787833770.332586:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3640:x1874679406045824:12345-0@lo:400: 00000100:00100000:2.0:1787833770.332642:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3640:x1874679406045824:12345-0@lo:400: Request processed in 58us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833770.332649:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787833770.332968:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406046848 00000100:00100000:0.0:1787833770.332974:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406046848 00000100:00100000:0.0:1787833770.333013:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833770.333020:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406046848:12345-0@lo:400: 00000100:00100000:0.0:1787833770.333058:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406046848:12345-0@lo:400: Request processed in 40us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833770.333064:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833770.333081:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406046336 00000100:00100000:0.0:1787833770.333084:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406046336 00000100:00100000:0.0:1787833770.333232:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787833770.333248:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c458780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406046336:12345-0@lo:400: 00000100:00100000:0.0:1787833770.333279:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c458780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406046336:12345-0@lo:400: Request processed in 33us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833770.333285:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787833770.333308:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406046208:0@lo:400: 00000100:00100000:1.0:1787833770.333314:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406045824:0@lo:400: 00000100:00100000:1.0:1787833770.333332:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406046336:0@lo:400: 00010000:00080000:1.0:1787833770.333347:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec52c0 x1874679406046848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833770.333359:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406046848:0@lo:400: 00000100:00100000:0.0:1787833770.333360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833770.333389:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406046720:0@lo:400: 00000100:00100000:0.0:1787833770.333420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833770.333532:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406046720 00000100:00100000:1.0:1787833770.333536:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406046720 00000100:00100000:1.0:1787833770.333572:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787833770.333579:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406046720:12345-0@lo:400: 00000100:00100000:1.0:1787833770.333614:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406046720:12345-0@lo:400: Request processed in 35us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833770.333619:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787833770.336940:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6212fda40 x1874679406046720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833770.336961:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406046720:0@lo:400: 00000100:00100000:0.0:1787833770.336994:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787833770.337006:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406046080:0@lo:400: 00000100:00100000:0.0:1787833770.337072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833770.337109:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406046592:0@lo:400: 00000100:00100000:0.0:1787833770.337133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833770.337157:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406047104:0@lo:400: 00000100:00100000:0.0:1787833770.337179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787833770.337206:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833770.337227:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406045952 00000100:00100000:0.0:1787833770.337245:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406045952 00000100:00100000:0.0:1787833770.337281:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406046208 00000100:00100000:0.0:1787833770.337284:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406046208 00000100:00100000:0.0:1787833770.337298:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406046592 00000100:00100000:0.0:1787833770.337301:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406046592 00000100:00100000:2.0:1787833770.337303:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406046080 00000100:00100000:2.0:1787833770.337309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406046080 00000100:00100000:0.0:1787833770.337324:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406047104 00000100:00100000:0.0:1787833770.337328:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406047104 00000100:00100000:2.0:1787833770.337351:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787833770.337355:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787833770.337364:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406046080:12345-0@lo:400: 00000100:00100000:0.0:1787833770.337366:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406045952:12345-0@lo:400: 00000100:00100000:0.0:1787833770.337430:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406045952:12345-0@lo:400: Request processed in 67us (10406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833770.337439:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787833770.337445:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406046080:12345-0@lo:400: Request processed in 83us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833770.337452:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787833770.337473:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787833770.337480:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787833770.337511:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406046080:0@lo:400: 00000100:00100000:0.0:1787833770.337929:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787833770.337937:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406046208:12345-0@lo:400: 00000100:00100000:0.0:1787833770.338004:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406046208:12345-0@lo:400: Request processed in 66us (4645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833770.338012:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787833770.338022:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a8f840 x1874679406046208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833770.338028:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787833770.338039:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406046592:12345-0@lo:400: 00000100:00100000:2.0:1787833770.338047:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406046208:0@lo:400: 00000100:00100000:0.0:1787833770.338084:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406046592:12345-0@lo:400: Request processed in 47us (949us total) trans 0 rc 0/0 00010000:00080000:2.0:1787833770.338093:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6212fc000 x1874679406046592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833770.338102:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787833770.338104:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406046592:0@lo:400: 00000100:00100000:0.0:1787833770.338122:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833770.338130:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406047104:12345-0@lo:400: 00000100:00100000:0.0:1787833770.338169:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406047104:12345-0@lo:400: Request processed in 40us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833770.338176:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787833770.338188:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec5680 x1874679406047104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787833770.338197:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787833770.338199:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406047104:0@lo:400: 00000100:00100000:3.0:1787833770.340182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833770.340243:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406046976:0@lo:400: 00000100:00100000:3.0:1787833770.340285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787833770.340338:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a8c3c0 x1874679406045952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833770.340344:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406046464 00000100:00100000:1.0:1787833770.340355:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406046464 00000100:00100000:1.0:1787833770.340407:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406046976 00000100:00100000:1.0:1787833770.340410:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406046976 00000100:00100000:1.0:1787833770.340427:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787833770.340436:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406046464:12345-0@lo:400: 00000100:00100000:1.0:1787833770.340489:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406046464:12345-0@lo:400: Request processed in 54us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833770.340496:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787833770.340512:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787833770.340518:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406046976:12345-0@lo:400: 00000100:00100000:1.0:1787833770.340542:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406046976:12345-0@lo:400: Request processed in 24us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833770.340548:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787833770.340564:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833770.341524:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406045952:0@lo:400: 00010000:00080000:3.0:1787833770.341689:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a8e580 x1874679406046464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833770.341700:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406046464:0@lo:400: 00010000:00080000:3.0:1787833770.341711:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec6580 x1874679406046976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833770.341720:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406046976:0@lo:400: 00010000:00010000:2.0:1787833770.775791:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833770.860161:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406047232:0@lo:41: 00000100:00100000:2.0:1787833770.860240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833770.864922:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406047232 00000100:00100000:3.0:1787833770.864936:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406047232 00000100:00100000:3.0:1787833770.865010:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787833770.865021:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406047232:12345-0@lo:41: 00000004:00000024:3.0:1787833770.865059:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787833770.869842:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406047232:12345-0@lo:41: Request processed in 4811us (9599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833770.869857:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787833770.870303:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406047232:0@lo:41: 00010000:00010000:3.0:1787833771.800423:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833772.377372:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406047360:0@lo:13: 00000100:00100000:2.0:1787833772.377434:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833772.377495:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406047360 00000100:00100000:2.0:1787833772.377501:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406047360 00000100:00100000:2.0:1787833772.377550:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833772.377559:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406047360:12345-0@lo:13: 00002000:00000024:2.0:1787833772.377584:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833772.377619:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406047360:12345-0@lo:13: Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833772.377626:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787833772.377645:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787833772.377666:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f412c0 x1874679406047360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833772.377697:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406047360:0@lo:13: 00000100:00100000:3.0:1787833772.379240:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406047488:0@lo:13: 00000100:00100000:3.0:1787833772.379303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833772.379359:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406047488 00000100:00100000:3.0:1787833772.379365:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406047488 00000100:00100000:3.0:1787833772.379415:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787833772.379422:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406047488:12345-0@lo:13: 00002000:00000024:3.0:1787833772.379441:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833772.379475:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406047488:12345-0@lo:13: Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833772.379482:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787833772.379498:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833772.379519:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec4780 x1874679406047488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833772.379533:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406047488:0@lo:13: 00000001:02000400:1.0:1787833772.431001:0:9873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787833772.822171:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787833773.466253:0:9925:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787833773.466488:0:9925:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787833773.848571:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833774.423648:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833774.423679:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406047616:0@lo:41: 00000100:00100000:0.0:1787833774.423863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.424572:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406047616 00000100:00100000:3.0:1787833774.424581:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406047616 00000100:00100000:3.0:1787833774.424635:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787833774.424644:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406047616:12345-0@lo:41: 00000004:00000024:3.0:1787833774.424689:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787833774.425140:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406047616:12345-0@lo:41: Request processed in 108us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.425149:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 10000000:01000000:0.0:1787833774.425302:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787833774.425307:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df6359b9000 from 39 10000000:01000000:0.0:1787833774.425311:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787833774.425352:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.425363:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.425374:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833774.425410:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406047744:0@lo:101: 00000100:00100000:0.0:1787833774.425467:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.425511:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833774.425555:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406047616:0@lo:41: 00000100:00100000:3.0:1787833774.427636:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406047744 00000100:00100000:3.0:1787833774.427656:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406047744 00000100:00100000:3.0:1787833774.427714:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787833774.427724:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406047744:12345-0@lo:101: 00010000:00010000:3.0:1787833774.427741:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833774.427787:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d20d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.427825:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d20d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.427837:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d20d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.427847:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247600, rc 0) 00000100:00100000:3.0:1787833774.427925:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406047744:12345-0@lo:101: Request processed in 202us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.427933:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787833774.429009:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406047744:0@lo:101: 00010000:00010000:1.0:1787833774.429036:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.429049:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833774.429159:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c459a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406047872:0@lo:501: 00000100:00100000:1.0:1787833774.429224:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.429266:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833774.429645:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406047872 00000100:00100000:0.0:1787833774.429662:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406047872 00000100:00100000:0.0:1787833774.429707:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787833774.429717:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406047872:12345-0@lo:501: 00000100:00100000:0.0:1787833774.429894:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406047872:12345-0@lo:501: Request processed in 177us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.429901:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787833774.429945:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c459a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406047872:0@lo:501: 00000100:00100000:0.0:1787833774.429982:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406048000:0@lo:503: 00000100:00100000:0.0:1787833774.430037:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.430247:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406048000 00000100:00100000:3.0:1787833774.430251:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406048000 00000100:00100000:3.0:1787833774.430282:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787833774.430289:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406048000:12345-0@lo:503: 00000100:00100000:0.0:1787833774.430823:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112eecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.438009:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406048000:12345-0@lo:503: Request processed in 7711us (7963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.438025:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787833774.438167:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406048000:0@lo:503: 00000100:00100000:1.0:1787833774.439926:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9966:1874679406048128:0@lo:502: 00000100:00100000:1.0:1787833774.440021:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.443271:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833774.444295:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406048128 00000100:00100000:0.0:1787833774.444307:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406048128 00000100:00100000:0.0:1787833774.444367:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787833774.444377:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9966:x1874679406048128:12345-0@lo:502: 00000100:00100000:0.0:1787833774.444643:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9966:x1874679406048128:12345-0@lo:502: Request processed in 268us (4623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.444661:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787833774.454080:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9966:1874679406048128:0@lo:502: 00000100:00100000:3.0:1787833774.454185:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9966:1874679406048256:0@lo:502: 00000100:00100000:3.0:1787833774.454289:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.454327:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.457233:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406048256 00000100:00100000:1.0:1787833774.457246:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406048256 00000100:00100000:1.0:1787833774.457308:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787833774.457318:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9966:x1874679406048256:12345-0@lo:502: 00000100:00100000:1.0:1787833774.457493:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:9966:x1874679406048256:12345-0@lo:502: Request processed in 175us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.457502:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787833774.457615:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9966:1874679406048256:0@lo:502: 00000040:00080000:3.0:1787833774.457662:0:9966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787833774.458630:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787833774.458659:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787833774.458670:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.458681:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833774.458690:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787833774.458693:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787833774.458695:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787833774.458730:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.458766:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.458777:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833774.458797:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406048384:0@lo:101: 00000100:00100000:1.0:1787833774.458853:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.458904:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833774.460397:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406048384 00000100:00100000:0.0:1787833774.460426:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406048384 00000100:00100000:0.0:1787833774.460474:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787833774.460483:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406048384:12345-0@lo:101: 00010000:00010000:0.0:1787833774.460497:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833774.460512:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d21b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.460537:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d21b expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.460547:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d21b expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.460555:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031600, rc 0) 00000100:00100000:0.0:1787833774.460634:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406048384:12345-0@lo:101: Request processed in 151us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.460640:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787833774.460692:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406048384:0@lo:101: 00010000:00010000:0.0:1787833774.460708:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.460717:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833774.460814:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406048512:0@lo:501: 00000100:00100000:0.0:1787833774.460844:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.460880:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c34840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.461145:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406048512 00000100:00100000:1.0:1787833774.461150:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406048512 00000100:00100000:1.0:1787833774.461188:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787833774.461197:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406048512:12345-0@lo:501: 00000100:00100000:1.0:1787833774.461332:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406048512:12345-0@lo:501: Request processed in 137us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.461339:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787833774.463993:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406048512:0@lo:501: 00000100:00100000:0.0:1787833774.464072:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406048640:0@lo:503: 00000100:00100000:0.0:1787833774.464148:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.464199:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c34840 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.464265:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406048640 00000100:00100000:3.0:1787833774.464272:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406048640 00000100:00100000:3.0:1787833774.464329:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787833774.464345:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406048640:12345-0@lo:503: 00000100:00100000:3.0:1787833774.464478:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406048640:12345-0@lo:503: Request processed in 133us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.464485:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787833774.464572:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406048640:0@lo:503: 00000100:00100000:0.0:1787833774.470055:0:9970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9970:1874679406048768:0@lo:502: 00000100:00100000:0.0:1787833774.470147:0:9970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.470196:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406048768 00000100:00100000:0.0:1787833774.470203:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406048768 00000100:00100000:0.0:1787833774.470275:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787833774.470284:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9970:x1874679406048768:12345-0@lo:502: 00000100:00100000:0.0:1787833774.470418:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9970:x1874679406048768:12345-0@lo:502: Request processed in 134us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.470426:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787833774.470484:0:9970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c34000 going to sleep for 11 seconds 00000100:00100000:0.0:1787833774.470507:0:9970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9970:1874679406048768:0@lo:502: 00000020:01000000:0.0:1787833774.470537:0:9970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833774.470546:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833774.470548:0:9970:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787833774.470552:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787833774.470554:0:9970:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787833774.470570:0:9970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9970:1874679406048896:0@lo:502: 00000100:00100000:0.0:1787833774.470603:0:9970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.470625:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406048896 00000100:00100000:0.0:1787833774.470629:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406048896 00000100:00100000:0.0:1787833774.470650:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787833774.470656:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9970:x1874679406048896:12345-0@lo:502: 00000100:00100000:0.0:1787833774.470725:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:9970:x1874679406048896:12345-0@lo:502: Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.470732:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787833774.470781:0:9970:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833774.470793:0:9970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9970:1874679406048896:0@lo:502: 00000020:01000000:0.0:1787833774.470811:0:9970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833774.470815:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833774.470817:0:9970:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787833774.470820:0:9970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787833774.470871:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787833774.470890:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787833774.470900:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.470920:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833774.470936:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787833774.470939:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df63b1db800 from 39 10000000:01000000:0.0:1787833774.470942:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787833774.470967:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.470975:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.470984:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833774.470995:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049024:0@lo:101: 00000100:00100000:0.0:1787833774.471027:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.471053:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833774.471067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406049024 00000100:00100000:0.0:1787833774.471070:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406049024 00000100:00100000:0.0:1787833774.471092:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787833774.471098:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406049024:12345-0@lo:101: 00010000:00010000:0.0:1787833774.471106:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833774.471117:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d229 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.471140:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d229 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.471152:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d229 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.471161:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031a00, rc 0) 00000100:00100000:0.0:1787833774.471187:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406049024:12345-0@lo:101: Request processed in 89us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.471193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787833774.474315:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049024:0@lo:101: 00010000:00010000:0.0:1787833774.474346:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.474359:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833774.474442:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049152:0@lo:501: 00000100:00100000:0.0:1787833774.474508:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.474547:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.477257:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406049152 00000100:00100000:1.0:1787833774.477277:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406049152 00000100:00100000:1.0:1787833774.477358:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787833774.477368:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406049152:12345-0@lo:501: 00000100:00100000:1.0:1787833774.477581:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406049152:12345-0@lo:501: Request processed in 213us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.477591:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787833774.483020:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049152:0@lo:501: 00000100:00100000:2.0:1787833774.483093:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049280:0@lo:503: 00000100:00100000:2.0:1787833774.483191:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.483282:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.491453:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406049280 00000100:00100000:1.0:1787833774.491466:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406049280 00000100:00100000:1.0:1787833774.491530:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787833774.491539:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406049280:12345-0@lo:503: 00000100:00100000:1.0:1787833774.491713:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406049280:12345-0@lo:503: Request processed in 175us (8522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.491721:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787833774.491805:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049280:0@lo:503: 00000100:00100000:1.0:1787833774.492013:0:9971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9971:1874679406049408:0@lo:502: 00000100:00100000:1.0:1787833774.492119:0:9971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.492147:0:9971:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.495826:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406049408 00000100:00100000:3.0:1787833774.495841:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406049408 00000100:00100000:3.0:1787833774.495941:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787833774.495951:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:9971:x1874679406049408:12345-0@lo:502: 00000100:00100000:3.0:1787833774.496155:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:9971:x1874679406049408:12345-0@lo:502: Request processed in 205us (4102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.496163:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787833774.502304:0:9971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9971:1874679406049408:0@lo:502: 00000100:00100000:0.0:1787833774.502393:0:9971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9971:1874679406049536:0@lo:502: 00000100:00100000:0.0:1787833774.502465:0:9971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.502515:0:9971:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.502567:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406049536 00000100:00100000:2.0:1787833774.502575:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406049536 00000100:00100000:2.0:1787833774.502636:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787833774.502646:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:9971:x1874679406049536:12345-0@lo:502: 00000100:00100000:2.0:1787833774.502800:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:9971:x1874679406049536:12345-0@lo:502: Request processed in 155us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.502808:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787833774.502897:0:9971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9971:1874679406049536:0@lo:502: 00000040:00080000:0.0:1787833774.502919:0:9971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787833774.503529:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787833774.503554:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787833774.503566:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.503578:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833774.503588:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787833774.503591:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df63b1db800 from 6 10000000:01000000:1.0:1787833774.503594:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787833774.503627:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.503636:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.503645:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833774.503663:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c459e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049664:0@lo:101: 00000100:00100000:1.0:1787833774.503713:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.504934:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833774.507655:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406049664 00000100:00100000:0.0:1787833774.507677:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406049664 00000100:00100000:0.0:1787833774.510373:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787833774.510392:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406049664:12345-0@lo:101: 00010000:00010000:0.0:1787833774.510411:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833774.510431:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030800/0x996d2fb20dc1d23e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d237 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.510465:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030800/0x996d2fb20dc1d23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d237 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.510478:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030800/0x996d2fb20dc1d23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d237 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.510488:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030800, rc 0) 00000100:00100000:0.0:1787833774.510577:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406049664:12345-0@lo:101: Request processed in 191us (6862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.510584:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787833774.510886:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c459e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049664:0@lo:101: 00010000:00010000:0.0:1787833774.510914:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.510924:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833774.510987:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049792:0@lo:256: 00000100:00100000:0.0:1787833774.511025:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.511123:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c34840 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.511197:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406049792 00000100:00100000:2.0:1787833774.511213:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406049792 00000100:00100000:2.0:1787833774.511258:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787833774.511266:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406049792:12345-0@lo:256: 20000000:01000000:2.0:1787833774.511280:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787833774.511298:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787833774.511301:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787833774.511391:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406049792:12345-0@lo:256: Request processed in 125us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.511398:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787833774.511493:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049792:0@lo:256: 10000000:01000000:0.0:1787833774.511539:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787833774.511548:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.511556:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833774.511566:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787833774.511568:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1787833774.511571:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787833774.511593:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.511600:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.511607:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833774.511625:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049920:0@lo:101: 00000100:00100000:0.0:1787833774.511650:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.511671:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.511712:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406049920 00000100:00100000:3.0:1787833774.511716:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406049920 00000100:00100000:3.0:1787833774.511898:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787833774.511906:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406049920:12345-0@lo:101: 00010000:00010000:3.0:1787833774.511916:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833774.511928:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d245 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.511948:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d245 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.511958:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d245 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.511966:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246200, rc 0) 00000100:00100000:3.0:1787833774.512002:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406049920:12345-0@lo:101: Request processed in 98us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.512016:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787833774.513930:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406049920:0@lo:101: 00010000:00010000:1.0:1787833774.513962:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.513974:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833774.514202:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406050048:0@lo:501: 00000100:00100000:1.0:1787833774.514284:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.514333:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.518225:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406050048 00000100:00100000:3.0:1787833774.518240:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406050048 00000100:00100000:3.0:1787833774.518305:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787833774.518315:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406050048:12345-0@lo:501: 00000100:00100000:3.0:1787833774.518511:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406050048:12345-0@lo:501: Request processed in 197us (4226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.518518:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787833774.518572:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406050048:0@lo:501: 00000100:00100000:3.0:1787833774.518620:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406050176:0@lo:503: 00000100:00100000:3.0:1787833774.518668:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.518698:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469300 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.518712:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406050176 00000100:00100000:3.0:1787833774.518715:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406050176 00000100:00100000:3.0:1787833774.518737:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787833774.518742:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406050176:12345-0@lo:503: 00000100:00100000:3.0:1787833774.519125:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406050176:12345-0@lo:503: Request processed in 373us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.519133:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787833774.520405:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406050176:0@lo:503: 00000100:00100000:0.0:1787833774.523312:0:9977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a983c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9977:1874679406050304:0@lo:502: 00000100:00100000:0.0:1787833774.523408:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.525009:0:9977:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c34840 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.531024:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406050304 00000100:00100000:3.0:1787833774.531042:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406050304 00000100:00100000:3.0:1787833774.531410:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787833774.531421:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:9977:x1874679406050304:12345-0@lo:502: 00000100:00100000:3.0:1787833774.531591:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:9977:x1874679406050304:12345-0@lo:502: Request processed in 171us (8183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.531598:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787833774.536512:0:9977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a983c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9977:1874679406050304:0@lo:502: 00000020:01000000:0.0:1787833774.536561:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787833774.536569:0:9977:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787833774.536577:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833774.536579:0:9977:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787833774.536584:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787833774.536587:0:9977:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:0.0:1787833774.536613:0:9977:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787833774.536615:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787833774.536643:0:9977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8df503f10000) 00000020:00000080:0.0:1787833774.536678:0:9977:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1787833774.536684:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787833774.536921:0:9977:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787833774.536928:0:9977:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787833774.536936:0:9977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1d25a 00010000:00080000:0.0:1787833774.536967:0:9977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df503c55000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:0.0:1787833774.537202:0:9977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1787833774.537355:0:9977:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787833774.537367:0:9977:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787833774.537546:0:9977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833774.537669:0:9977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833774.537860:0:9977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787833774.537949:0:9977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787833774.540504:0:9980:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833774.540512:0:9980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787833774.542092:0:9977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787833774.542106:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787833774.542152:0:9977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787833774.542183:0:9977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1d261 00000100:00080000:0.0:1787833774.542194:0:9977:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787833774.542201:0:9977:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df503c55000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787833774.542247:0:9977:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a983c0 x1874679406050432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787833774.542276:0:9977:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787833774.542330:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833774.542335:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833774.542336:0:9977:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787833774.542339:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833774.542344:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833774.542345:0:9977:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787833774.542348:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787833774.542350:0:9977:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787833774.542380:0:9977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9977:1874679406050560:0@lo:502: 00000100:00100000:0.0:1787833774.542460:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.542494:0:9977:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.542645:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406050944:0@lo:400: 00000100:00100000:3.0:1787833774.542690:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.542710:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406051456:0@lo:400: 00000100:00100000:3.0:1787833774.542734:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.542786:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787833774.542792:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406050816:0@lo:400: 00000100:00100000:3.0:1787833774.542816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.542834:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406051328:0@lo:400: 00000100:00100000:3.0:1787833774.542856:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.542884:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406051456 00000100:00100000:3.0:1787833774.542891:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406051456 00000100:00100000:3.0:1787833774.542934:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406051328 00000100:00100000:3.0:1787833774.542937:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406051328 00000100:00100000:3.0:1787833774.542958:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787833774.542966:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406051456:12345-0@lo:400: 00000100:00100000:3.0:1787833774.543016:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406051456:12345-0@lo:400: Request processed in 50us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.543023:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787833774.543039:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833774.543045:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406051328:12345-0@lo:400: 00000100:00100000:3.0:1787833774.543071:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406051328:12345-0@lo:400: Request processed in 27us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.543077:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833774.543095:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406050816 00000100:00100000:3.0:1787833774.543098:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406050816 00000100:00100000:3.0:1787833774.543121:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787833774.543128:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406050816:12345-0@lo:400: 00000100:00100000:3.0:1787833774.543174:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406050816:12345-0@lo:400: Request processed in 46us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.543180:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787833774.543197:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833774.543247:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406050816:0@lo:400: 00010000:00080000:3.0:1787833774.543260:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec43c0 x1874679406051328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833774.543270:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406051328:0@lo:400: 00010000:00080000:3.0:1787833774.543279:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec4f00 x1874679406051456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833774.543288:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406051456:0@lo:400: 00000100:00100000:1.0:1787833774.544182:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406050432:0@lo:8: 00000100:00100000:1.0:1787833774.544253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.544305:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406050560 00000100:00100000:1.0:1787833774.544312:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406050560 00000100:00100000:1.0:1787833774.544353:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787833774.544359:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:9977:x1874679406050560:12345-0@lo:502: 00000100:00100000:1.0:1787833774.544488:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:9977:x1874679406050560:12345-0@lo:502: Request processed in 127us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.544496:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787833774.544540:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406051072:0@lo:400: 00000100:00100000:1.0:1787833774.544568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.544597:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406051584:0@lo:400: 00000100:00100000:2.0:1787833774.544601:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406050944 00000100:00100000:2.0:1787833774.544605:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406050944 00000100:00100000:1.0:1787833774.544617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.544632:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406051072 00000100:00100000:2.0:1787833774.544635:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406051072 00000100:00100000:2.0:1787833774.544652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406051584 00000100:00100000:2.0:1787833774.544655:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406051584 00000100:00100000:2.0:1787833774.544669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787833774.544675:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406050944:12345-0@lo:400: 00000100:00100000:2.0:1787833774.544716:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406050944:12345-0@lo:400: Request processed in 41us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.544722:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787833774.544734:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787833774.544739:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406051072:12345-0@lo:400: 00000100:00100000:2.0:1787833774.544783:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406051072:12345-0@lo:400: Request processed in 44us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.544789:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787833774.544800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787833774.544806:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406051584:12345-0@lo:400: 00000100:00100000:2.0:1787833774.544830:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406051584:12345-0@lo:400: Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.544835:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787833774.546225:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec4b40 x1874679406051072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833774.546253:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406051072:0@lo:400: 00010000:00080000:1.0:1787833774.546273:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec5a40 x1874679406051584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833774.546283:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406051584:0@lo:400: 00000100:00100000:1.0:1787833774.546311:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787833774.546324:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406050688:0@lo:400: 00000100:00100000:1.0:1787833774.546391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.546424:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406051200:0@lo:400: 00000100:00100000:1.0:1787833774.546444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.546455:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406051712:0@lo:400: 00000100:00100000:1.0:1787833774.546473:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.546510:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406050688 00000100:00100000:1.0:1787833774.546515:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406050688 00000100:00100000:1.0:1787833774.546547:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406051200 00000100:00100000:1.0:1787833774.546550:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406051200 00000100:00100000:1.0:1787833774.546583:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406051712 00000100:00100000:1.0:1787833774.546586:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406051712 00000100:00100000:1.0:1787833774.546602:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787833774.546609:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406050688:12345-0@lo:400: 00000100:00100000:3.0:1787833774.546614:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787833774.546622:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c459e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406051200:12345-0@lo:400: 00000100:00100000:1.0:1787833774.546673:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406050688:12345-0@lo:400: Request processed in 65us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.546680:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787833774.546696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787833774.546702:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406051712:12345-0@lo:400: 00000100:00080000:2.0:1787833774.547935:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833774.547945:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833774.547964:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406050432 00000100:00100000:2.0:1787833774.547974:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406050432 00000100:00100000:2.0:1787833774.548017:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833774.548024:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874679406050432:12345-0@lo:8: 00010000:00080000:2.0:1787833774.548062:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1787833774.548104:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1d268 00002000:00100000:2.0:1787833774.548119:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8df5038ad000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787833774.548123:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787833774.548127:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787833774.548198:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787833774.548473:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c459e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406051200:12345-0@lo:400: Request processed in 1846us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.548481:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787833774.549064:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec5e00 x1874679406050944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833774.549080:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406050944:0@lo:400: 00002000:00080000:2.0:1787833774.549706:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787833774.549740:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8df5038ab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833774.549863:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874679406050432:12345-0@lo:8: Request processed in 1838us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.549873:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787833774.549889:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406051712:12345-0@lo:400: Request processed in 3186us (3414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.549912:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787833774.549979:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a983c0 x1874679406050432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787833784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833774.549990:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787833774.549997:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787833774.550006:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787833774.550012:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787833774.550015:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df503c55000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787833774.550031:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787833774.550037:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406050432:0@lo:8: 00000100:00100000:1.0:1787833774.550234:0:9977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9977:1874679406050560:0@lo:502: 00000020:01000000:1.0:1787833774.550300:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833774.550308:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833774.550310:0:9977:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787833774.550320:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1787833774.550697:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787833774.550719:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787833774.550729:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.550740:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833774.550778:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787833774.550781:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df60efc3000 from 39 10000000:01000000:2.0:1787833774.550785:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833774.550821:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.550828:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.550846:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833774.550880:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f42d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406051840:0@lo:101: 00000100:00100000:2.0:1787833774.550941:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.550982:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b0720c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787833774.551049:0:9980:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787833774.551123:0:9980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 250464372069ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787833774.551131:0:9980:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787833774.551141:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406051840 00000100:00100000:3.0:1787833774.551148:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406051840 00000100:00100000:3.0:1787833774.551201:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787833774.551220:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406051840:12345-0@lo:101: 00010000:00010000:3.0:1787833774.551232:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833774.551251:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d26f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.551275:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d26f expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.551286:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d26f expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.551295:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247c00, rc 0) 00000100:00100000:3.0:1787833774.551340:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406051840:12345-0@lo:101: Request processed in 122us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.551346:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787833774.551380:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f42d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406051840:0@lo:101: 00010000:00010000:2.0:1787833774.551395:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.551406:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787833774.551443:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec7480 x1874679406050688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833774.551457:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406050688:0@lo:400: 00000100:00100000:2.0:1787833774.551466:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f42d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406051968:0@lo:501: 00000100:00100000:3.0:1787833774.551521:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1874679406052096:0@lo:700: 00000100:00100000:3.0:1787833774.551554:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.551586:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406052096 00000100:00100000:3.0:1787833774.551589:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406052096 00000100:00100000:3.0:1787833774.551622:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833774.551628:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9981:x1874679406052096:12345-0@lo:700: 00000100:00100000:3.0:1787833774.551669:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1874679406052224:0@lo:700: 00000100:00100000:3.0:1787833774.551695:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.551711:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.551740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406052224 00000100:00100000:3.0:1787833774.551744:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406052224 00000100:00100000:3.0:1787833774.551792:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833774.551799:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1874679406052224:12345-0@lo:700: 00000100:00100000:1.0:1787833774.551799:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 2 min 2 max 256 00000100:00100000:1.0:1787833774.551807:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0002' 00000100:00080000:3.0:1787833774.551876:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833774.551884:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469900 going to sleep for 11 seconds 00010000:00080000:0.0:1787833774.556827:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec61c0 x1874679406051200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833774.556870:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406051200:0@lo:400: 00010000:00080000:0.0:1787833774.556890:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec4000 x1874679406051712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833774.556898:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406051712:0@lo:400: 00000100:00100000:2.0:1787833774.557339:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.557813:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b0720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.557864:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406051968 00000100:00100000:3.0:1787833774.558785:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406051968 00000100:00100000:3.0:1787833774.558858:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787833774.558868:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406051968:12345-0@lo:501: 00000100:00100000:3.0:1787833774.559070:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406051968:12345-0@lo:501: Request processed in 203us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.559078:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787833774.559146:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f42d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406051968:0@lo:501: 00000100:00100000:3.0:1787833774.560327:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406052352:0@lo:503: 00000100:00100000:3.0:1787833774.560412:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.560462:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469b40 going to sleep for 11 seconds 00000001:00100000:1.0:1787833774.561024:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787833774.561700:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406052352 00000100:00100000:0.0:1787833774.561710:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406052352 00000100:00100000:0.0:1787833774.561774:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787833774.561784:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406052352:12345-0@lo:503: 00000100:00100000:0.0:1787833774.561933:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406052352:12345-0@lo:503: Request processed in 151us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.561942:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787833774.562021:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406052352:0@lo:503: 40000000:02000000:0.0:1787833774.562634:0:6521:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1787833774.563304:0:9983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9983:1874679406052480:0@lo:502: 00000100:00100000:1.0:1787833774.563385:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.563434:0:9983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.563790:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406052480 00000100:00100000:2.0:1787833774.563799:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406052480 00000100:00100000:2.0:1787833774.563853:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787833774.563863:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:9983:x1874679406052480:12345-0@lo:502: 00000100:00100000:2.0:1787833774.564002:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:9983:x1874679406052480:12345-0@lo:502: Request processed in 140us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.564010:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000004:00080000:1.0:1787833774.564073:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787833774.564124:0:9983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9983:1874679406052480:0@lo:502: 00000100:00100000:1.0:1787833774.564180:0:9983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9983:1874679406052608:0@lo:502: 00000100:00100000:1.0:1787833774.564233:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.564267:0:9983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.564698:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406052608 00000100:00100000:2.0:1787833774.564703:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406052608 00000100:00100000:2.0:1787833774.564743:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787833774.564769:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:9983:x1874679406052608:12345-0@lo:502: 00000100:00100000:2.0:1787833774.564939:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:9983:x1874679406052608:12345-0@lo:502: Request processed in 188us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.564947:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787833774.567261:0:9983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9983:1874679406052608:0@lo:502: 00000040:00080000:1.0:1787833774.567316:0:9983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787833774.567475:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787833774.567502:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787833774.567514:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.567527:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833774.567539:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787833774.567542:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60efc3000 from 6 10000000:01000000:2.0:1787833774.567545:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787833774.567590:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.567599:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.567609:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833774.567628:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406052736:0@lo:101: 00000100:00100000:2.0:1787833774.567691:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.567732:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b0726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.567773:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406052736 00000100:00100000:2.0:1787833774.567779:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406052736 00000100:00100000:2.0:1787833774.567825:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787833774.567907:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406052736:12345-0@lo:101: 00010000:00010000:2.0:1787833774.567937:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833774.567951:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d27d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.567977:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d27d expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.567987:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d27d expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.567996:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f000, rc 0) 00000100:00100000:2.0:1787833774.568035:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406052736:12345-0@lo:101: Request processed in 200us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.568042:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787833774.568084:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406052736:0@lo:101: 00010000:00010000:2.0:1787833774.568097:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.568106:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833774.568150:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406052864:0@lo:256: 00000100:00100000:2.0:1787833774.568269:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.568292:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b0726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.569182:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406052864 00000100:00100000:1.0:1787833774.569192:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406052864 00000100:00100000:1.0:1787833774.569251:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787833774.569261:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406052864:12345-0@lo:256: 20000000:01000000:1.0:1787833774.569282:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787833774.569303:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787833774.569306:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787833774.569421:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406052864:12345-0@lo:256: Request processed in 162us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.569429:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787833774.569474:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f42940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406052864:0@lo:256: 10000000:01000000:1.0:1787833774.569525:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787833774.569536:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.569548:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833774.569557:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787833774.569560:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787833774.569564:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787833774.569608:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.569625:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.569635:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833774.569650:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406052992:0@lo:101: 00000100:00100000:1.0:1787833774.569683:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.569712:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.569726:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406052992 00000100:00100000:1.0:1787833774.569730:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406052992 00000100:00100000:1.0:1787833774.571478:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787833774.571500:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406052992:12345-0@lo:101: 00010000:00010000:1.0:1787833774.571519:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833774.571539:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d28b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.571570:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d28b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.571583:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d28b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.571594:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a800, rc 0) 00000100:00100000:1.0:1787833774.571684:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406052992:12345-0@lo:101: Request processed in 195us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.571692:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787833774.571969:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406052992:0@lo:101: 00010000:00010000:2.0:1787833774.571991:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.572023:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833774.572112:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f40780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406053120:0@lo:501: 00000100:00100000:2.0:1787833774.572149:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.572196:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b0723c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.572990:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406053120 00000100:00100000:1.0:1787833774.573014:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406053120 00000100:00100000:1.0:1787833774.573061:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787833774.573069:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406053120:12345-0@lo:501: 00000100:00100000:1.0:1787833774.573228:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406053120:12345-0@lo:501: Request processed in 159us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.573235:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787833774.573285:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f40780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406053120:0@lo:501: 00000100:00100000:2.0:1787833774.573324:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f40780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406053248:0@lo:503: 00000100:00100000:2.0:1787833774.573457:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.573490:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b0723c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.574484:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406053248 00000100:00100000:1.0:1787833774.574494:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406053248 00000100:00100000:1.0:1787833774.574538:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787833774.574547:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406053248:12345-0@lo:503: 00000100:00100000:1.0:1787833774.574683:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406053248:12345-0@lo:503: Request processed in 137us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.574691:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787833774.574776:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f40780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406053248:0@lo:503: 00000100:00100000:1.0:1787833774.577267:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9984:1874679406053376:0@lo:502: 00000100:00100000:1.0:1787833774.577361:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.577409:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.577433:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406053376 00000100:00100000:2.0:1787833774.577442:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406053376 00000100:00100000:2.0:1787833774.577497:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787833774.577508:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:9984:x1874679406053376:12345-0@lo:502: 00000100:00100000:2.0:1787833774.577655:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:9984:x1874679406053376:12345-0@lo:502: Request processed in 149us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.577664:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787833774.577985:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9984:1874679406053376:0@lo:502: 00000020:01000000:1.0:1787833774.578020:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787833774.578028:0:9984:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787833774.578035:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833774.578038:0:9984:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787833774.578046:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787833774.578128:0:9984:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:1.0:1787833774.578154:0:9984:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787833774.578158:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787833774.578172:0:9984:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df635860000) 00000020:00000080:1.0:1787833774.578196:0:9984:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1787833774.578202:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787833774.578319:0:9984:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787833774.578327:0:9984:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787833774.578334:0:9984:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1d2a0 00010000:00080000:1.0:1787833774.578364:0:9984:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df503f94800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787833774.578587:0:9984:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1787833774.578723:0:9984:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787833774.578733:0:9984:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1787833774.579378:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1874679406052224:12345-0@lo:700: Request processed in 27574us (27677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.579389:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787833774.579455:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec43c0 x1874679406052224/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833774.579470:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1874679406052224:0@lo:700: 40000000:02000000:0.0:1787833774.579483:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1787833774.581149:0:9984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833774.581293:0:9984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833774.581429:0:9984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787833774.581546:0:9984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787833774.584370:0:9986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833774.584378:0:9986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787833774.591354:0:9984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787833774.591370:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787833774.591416:0:9984:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787833774.591444:0:9984:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1d2a7 00000100:00080000:1.0:1787833774.591456:0:9984:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787833774.591464:0:9984:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df503f94800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787833774.591503:0:9984:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df63c4592c0 x1874679406053504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787833774.591539:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406053504:0@lo:8: 00000100:00100000:1.0:1787833774.591612:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787833774.591675:0:9984:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787833774.591885:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406053504 00000100:00100000:3.0:1787833774.591894:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406053504 00000100:00100000:3.0:1787833774.591935:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833774.591943:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c459a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406053504:12345-0@lo:8: 00010000:00080000:3.0:1787833774.591971:0:8431:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1787833774.591996:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1d2ae 00002000:00100000:3.0:1787833774.592010:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df503db2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787833774.592014:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787833774.592018:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787833774.592102:0:8431:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787833774.592126:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8df503db4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833774.592183:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c459a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874679406053504:12345-0@lo:8: Request processed in 239us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.592200:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:1.0:1787833774.595023:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00080000:1.0:1787833774.595094:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63c4592c0 x1874679406053504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787833784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833774.595109:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787833774.595120:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787833774.595129:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787833774.595135:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787833774.595159:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df503f94800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787833774.595188:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787833774.595195:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406053504:0@lo:8: 00000020:00000080:1.0:1787833774.595239:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833774.595241:0:9984:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787833774.595246:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833774.595251:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833774.595253:0:9984:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787833774.595256:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787833774.595258:0:9984:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787833774.595300:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9984:1874679406053632:0@lo:502: 00000100:00100000:1.0:1787833774.595380:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787833774.595437:0:9986:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787833774.595495:0:9986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 250508743632ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787833774.595501:0:9986:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787833774.605522:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406053632 00000100:00100000:2.0:1787833774.605538:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406053632 00000100:00100000:1.0:1787833774.605581:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.605606:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787833774.605617:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:9984:x1874679406053632:12345-0@lo:502: 00000100:00100000:2.0:1787833774.605785:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:9984:x1874679406053632:12345-0@lo:502: Request processed in 168us (10403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.605793:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787833774.607120:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:9984:1874679406053632:0@lo:502: 00000020:01000000:1.0:1787833774.607165:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833774.607172:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833774.607174:0:9984:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787833774.607179:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:0.0:1787833774.607552:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787833774.607916:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833774.607943:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406053760:0@lo:13: 00000100:00100000:2.0:1787833774.608009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.608053:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406053760 00000100:00100000:2.0:1787833774.608059:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406053760 00000100:00100000:2.0:1787833774.608113:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787833774.608121:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406053760:12345-0@lo:13: 00002000:00000024:2.0:1787833774.608148:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787833774.608279:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406053760:12345-0@lo:13: Request processed in 157us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.608285:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787833774.608304:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787833774.608333:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f430c0 x1874679406053760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833774.608428:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406053760:0@lo:13: 00000004:00080000:2.0:1787833774.608447:0:9987:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787833774.608467:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1874679406053888:0@lo:7: 00000100:00100000:2.0:1787833774.608493:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.608517:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833774.608850:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406053888 00000100:00100000:0.0:1787833774.608857:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406053888 00000100:00100000:0.0:1787833774.608893:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787833774.608901:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9987:x1874679406053888:12345-0@lo:7: 00000020:01000000:3.0:1787833774.616134:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1787833774.616175:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787833774.616187:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.616200:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833774.616313:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787833774.616317:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df60ec73490 from 1 10000000:01000000:2.0:1787833774.616321:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787833774.616366:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.616375:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.616385:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833774.616423:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406054016:0@lo:101: 00000100:00100000:2.0:1787833774.616490:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.616535:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b0726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.617318:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406054016 00000100:00100000:3.0:1787833774.617328:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406054016 00000100:00100000:3.0:1787833774.617390:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787833774.617401:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406054016:12345-0@lo:101: 00010000:00010000:3.0:1787833774.617417:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833774.617433:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d2b5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.617460:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d2b5 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.617473:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d2b5 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.617481:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247200, rc 0) 00000100:00100000:3.0:1787833774.617540:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406054016:12345-0@lo:101: Request processed in 141us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.617560:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787833774.617660:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406054016:0@lo:101: 00010000:00010000:2.0:1787833774.617678:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.617687:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833774.617805:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406054144:0@lo:501: 00000100:00100000:2.0:1787833774.617840:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.617879:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b0726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833774.617994:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406054144 00000100:00100000:3.0:1787833774.617998:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406054144 00000100:00100000:3.0:1787833774.618028:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787833774.618036:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406054144:12345-0@lo:501: 00000100:00100000:3.0:1787833774.618125:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406054144:12345-0@lo:501: Request processed in 88us (283us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787833774.618133:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787833774.619934:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406054144:0@lo:501: 10000000:01000000:2.0:1787833774.619990:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787833774.620001:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.620012:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787833774.621390:0:8583:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787833774.621399:0:8583:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787833774.621499:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9987:x1874679406053888:12345-0@lo:7: Request processed in 12595us (13001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.621509:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787833774.622526:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f430c0 x1874679406053888/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833774.622543:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1874679406053888:0@lo:7: 00000004:00080000:2.0:1787833774.622556:0:9987:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787833774.622610:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1874679406054272:0@lo:5: 00000100:00100000:2.0:1787833774.622660:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.622696:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.622783:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406054272 00000100:00100000:1.0:1787833774.622792:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406054272 00000100:00100000:1.0:1787833774.622850:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787833774.622860:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9987:x1874679406054272:12345-0@lo:5: 00002000:00080000:1.0:1787833774.622889:0:8430:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787833774.622893:0:8430:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00100000:3.0:1787833774.624892:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787833774.625258:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9981:x1874679406052096:12345-0@lo:700: Request processed in 73623us (73697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.625271:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787833774.625330:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec5e00 x1874679406052096/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833774.625345:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1874679406052096:0@lo:700: 00000004:00080000:0.0:1787833774.636480:0:9981:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787833774.636516:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1874679406054528:0@lo:7: 00000100:00100000:0.0:1787833774.636598:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.636641:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.636700:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406054400:0@lo:13: 00000100:00100000:2.0:1787833774.636742:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.636856:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406054528 00000100:00100000:3.0:1787833774.636864:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406054528 00000100:00100000:3.0:1787833774.636918:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787833774.636928:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9981:x1874679406054528:12345-0@lo:7: 00000100:00100000:0.0:1787833774.636992:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406054400 00000100:00100000:0.0:1787833774.636997:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406054400 00000100:00100000:0.0:1787833774.637037:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787833774.637045:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874679406054400:12345-0@lo:13: 00002000:00000024:0.0:1787833774.637065:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1787833774.637114:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874679406054400:12345-0@lo:13: Request processed in 70us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833774.637121:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787833774.637214:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a9a940 x1874679406054400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833774.637234:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406054400:0@lo:13: 00000001:00080000:1.0:1787833774.640581:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1787833774.646266:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9987:x1874679406054272:12345-0@lo:5: Request processed in 23399us (23596us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787833774.646280:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787833774.647313:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f430c0 x1874679406054272/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833774.647326:0:9987:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787833774.647333:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1874679406054272:0@lo:5: 00000004:00080000:0.0:1787833774.647349:0:9987:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787833774.647397:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a992c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1874679406054656:0@lo:700: 00000100:00100000:0.0:1787833774.647444:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833774.647484:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833774.649634:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406054656 00000100:00100000:1.0:1787833774.649647:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406054656 00000100:00100000:1.0:1787833774.649715:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833774.649725:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9987:x1874679406054656:12345-0@lo:700: 00000100:00100000:3.0:1787833774.652962:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9987:x1874679406054656:12345-0@lo:700: Request processed in 3226us (5504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.652977:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787833774.653134:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a992c0 x1874679406054656/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833774.653162:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a992c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1874679406054656:0@lo:700: 00000004:02000040:0.0:1787833774.656241:0:9987:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:2.0:1787833774.658515:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787833774.658527:0:8432:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787833774.658634:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9981:x1874679406054528:12345-0@lo:7: Request processed in 21702us (22030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.658645:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787833774.658718:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a9a580 x1874679406054528/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833774.658735:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1874679406054528:0@lo:7: 00000004:00080000:3.0:1787833774.658776:0:9981:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787833774.658818:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1874679406054784:0@lo:5: 00000100:00100000:3.0:1787833774.658856:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.658899:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.660233:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406054784 00000100:00100000:2.0:1787833774.660244:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406054784 00000100:00100000:2.0:1787833774.660311:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833774.660321:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9981:x1874679406054784:12345-0@lo:5: 00002000:00080000:2.0:1787833774.660354:0:8431:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787833774.660433:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9981:x1874679406054784:12345-0@lo:5: Request processed in 113us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.660440:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787833774.660499:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec5e00 x1874679406054784/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833774.660515:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1874679406054784:0@lo:5: 00000004:00080000:1.0:1787833774.660529:0:9981:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787833774.660569:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1874679406054912:0@lo:5: 00000100:00100000:1.0:1787833774.660606:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.660637:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.660820:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406054912 00000100:00100000:2.0:1787833774.660825:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406054912 00000100:00100000:2.0:1787833774.660855:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787833774.660863:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9981:x1874679406054912:12345-0@lo:5: 00002000:00080000:2.0:1787833774.660892:0:8430:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1787833774.662646:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9981:x1874679406054912:12345-0@lo:5: Request processed in 1778us (2034us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787833774.662657:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787833774.662809:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63c4592c0 x1874679406054912/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833774.662826:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c4592c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9981:1874679406054912:0@lo:5: 00000004:00080000:1.0:1787833774.662839:0:9981:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787833774.662878:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9981:1874679406055040:0@lo:900: 00000100:00100000:1.0:1787833774.662916:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.662943:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.666775:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406055040 00000100:00100000:2.0:1787833774.666789:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406055040 00000100:00100000:2.0:1787833774.666861:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833774.666872:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9981:x1874679406055040:12345-0@lo:900: 00000100:00100000:3.0:1787833774.668136:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9981:x1874679406055040:12345-0@lo:900: Request processed in 1258us (5211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.668150:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787833774.669241:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1874679406055168:0@lo:5: 00000100:00100000:3.0:1787833774.669316:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.669357:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833774.669419:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406055168 00000100:00100000:2.0:1787833774.669427:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406055168 00000100:00100000:2.0:1787833774.669479:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787833774.669488:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9987:x1874679406055168:12345-0@lo:5: 00010000:00080000:1.0:1787833774.671007:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63c45a580 x1874679406055040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833774.671024:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9981:1874679406055040:0@lo:900: 00002000:00080000:3.0:1787833774.675194:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787833774.675228:0:8431:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1787833774.677693:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9987:x1874679406055168:12345-0@lo:5: Request processed in 8199us (8369us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787833774.677705:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787833774.678196:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec7480 x1874679406055168/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833790 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833774.678229:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1874679406055168:0@lo:5: 00000004:00080000:0.0:1787833774.678245:0:9987:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1787833774.870278:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787833775.607855:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1787833775.607875:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787833775.908862:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833775.957870:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833775.957894:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406055296:0@lo:41: 00000100:00100000:1.0:1787833775.957965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833775.958061:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406055296 00000100:00100000:2.0:1787833775.958068:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406055296 00000100:00100000:2.0:1787833775.958124:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787833775.958134:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406055296:12345-0@lo:41: 00000004:00000024:2.0:1787833775.958166:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787833775.958283:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406055296:12345-0@lo:41: Request processed in 149us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833775.958292:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787833775.965161:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406055296:0@lo:41: 00000020:00000004:0.0:1787833776.642120:0:10037:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787833776.642546:0:10037:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787833776.918988:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833777.500549:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833777.500579:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406055424:0@lo:13: 00000100:00100000:2.0:1787833777.500670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833777.500743:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406055424 00000100:00100000:2.0:1787833777.500768:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406055424 00000100:00100000:2.0:1787833777.500819:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787833777.500827:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406055424:12345-0@lo:13: 00002000:00000024:2.0:1787833777.500855:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833777.500897:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406055424:12345-0@lo:13: Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833777.500903:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787833777.500922:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787833777.500946:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f42d00 x1874679406055424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833777.500962:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406055424:0@lo:13: 00000100:00100000:1.0:1787833777.503623:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406055552:0@lo:13: 00000100:00100000:1.0:1787833777.503692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833777.503795:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406055552 00000100:00100000:1.0:1787833777.503802:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406055552 00000100:00100000:1.0:1787833777.503853:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787833777.503860:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406055552:12345-0@lo:13: 00002000:00000024:1.0:1787833777.503881:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833777.503921:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406055552:12345-0@lo:13: Request processed in 61us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833777.503927:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787833777.503947:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787833777.503970:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a8f840 x1874679406055552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833777.503988:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406055552:0@lo:13: 00000020:00000004:3.0:1787833777.830844:0:10085:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787833777.830854:0:10085:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1787833777.943309:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833778.469581:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833778.469700:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381885056 00000100:00100000:3.0:1787833778.469710:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381885056 00000100:00100000:3.0:1787833778.469785:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 184 00000100:00100000:3.0:1787833778.469793:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2397:x1874679381885056:12345-192.168.203.17@tcp:250: 00010000:00080000:1.0:1787833778.469903:0:6508:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 7cc589ca-8d60-40bb-ae0e-5988c094f6be@192.168.203.17@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1787833778.469936:0:6508:0:(genops.c:1385:class_connect()) connect: client 7cc589ca-8d60-40bb-ae0e-5988c094f6be, cookie 0x996d2fb20dc1d2c3 00000100:00080000:1.0:1787833778.470085:0:6508:0:(import.c:65:import_set_state_nolock()) ffff8df503f93800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833778.470163:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+5:2397:x1874679381885056:12345-192.168.203.17@tcp:250: Request processed in 369us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833778.470172:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 184 00000100:00100000:0.0:1787833778.482616:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833778.482918:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381885184 00000100:00100000:1.0:1787833778.482928:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381885184 00000100:00100000:1.0:1787833778.482986:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 185 00000100:00100000:1.0:1787833778.482995:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+5:6161:x1874679381885184:12345-192.168.203.17@tcp:101: 00010000:00010000:1.0:1787833778.483012:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833778.483028:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91e9fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833778.483055:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91e9fc expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833778.483081:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91e9fc expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833778.483091:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b800, rc 0) 00000100:00100000:1.0:1787833778.483156:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+6:6161:x1874679381885184:12345-192.168.203.17@tcp:101: Request processed in 161us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833778.483163:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 185 00000100:00100000:2.0:1787833778.489407:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833778.489599:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381885312 00000100:00100000:1.0:1787833778.489609:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381885312 00000100:00100000:1.0:1787833778.489957:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 186 00000100:00100000:1.0:1787833778.489971:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+6:6161:x1874679381885312:12345-192.168.203.17@tcp:501: 00000100:00100000:1.0:1787833778.490098:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+6:6161:x1874679381885312:12345-192.168.203.17@tcp:501: Request processed in 131us (781us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787833778.490105:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 186 00000100:00100000:3.0:1787833778.497898:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833778.502349:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381885440 00000100:00100000:2.0:1787833778.502366:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381885440 00000100:00100000:2.0:1787833778.502448:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 187 00000100:00100000:2.0:1787833778.502458:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+6:6161:x1874679381885440:12345-192.168.203.17@tcp:101: 00010000:00010000:2.0:1787833778.502485:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833778.502505:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ea03 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833778.502534:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea03 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833778.502546:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea03 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833778.502571:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f800, rc 0) 00000100:00100000:2.0:1787833778.502659:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+7:6161:x1874679381885440:12345-192.168.203.17@tcp:101: Request processed in 202us (4772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833778.502666:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 187 00000100:00100000:0.0:1787833778.505369:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833778.505575:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381885568 00000100:00100000:3.0:1787833778.505584:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381885568 00000100:00100000:3.0:1787833778.505637:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 188 00000100:00100000:3.0:1787833778.505655:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+7:6161:x1874679381885568:12345-192.168.203.17@tcp:501: 00000100:00100000:3.0:1787833778.506004:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:6161:x1874679381885568:12345-192.168.203.17@tcp:501: Request processed in 349us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833778.506012:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 188 00000100:00100000:3.0:1787833778.511141:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833778.511586:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381885696 00000100:00100000:1.0:1787833778.511599:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381885696 00000100:00100000:1.0:1787833778.511672:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:1.0:1787833778.511682:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:6161:x1874679381885696:12345-192.168.203.17@tcp:503: 00000100:00100000:1.0:1787833778.512115:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:6161:x1874679381885696:12345-192.168.203.17@tcp:503: Request processed in 433us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833778.512124:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:0.0:1787833778.517952:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833778.519110:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381885824 00000100:00100000:2.0:1787833778.519125:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381885824 00000100:00100000:2.0:1787833778.519197:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:2.0:1787833778.519207:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:6179:x1874679381885824:12345-192.168.203.17@tcp:502: 00000100:00100000:2.0:1787833778.519388:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:6179:x1874679381885824:12345-192.168.203.17@tcp:502: Request processed in 182us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833778.519396:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:0.0:1787833778.587640:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833778.588632:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381885952 00000100:00100000:1.0:1787833778.588656:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381885952 00000100:00100000:1.0:1787833778.588727:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:1.0:1787833778.588738:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:6179:x1874679381885952:12345-192.168.203.17@tcp:502: 00000100:00100000:1.0:1787833778.588963:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:6179:x1874679381885952:12345-192.168.203.17@tcp:502: Request processed in 224us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833778.588970:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:0.0:1787833778.601821:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833778.601912:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381886080 00000100:00100000:3.0:1787833778.601922:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381886080 00000100:00100000:3.0:1787833778.601969:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 192 00000100:00100000:3.0:1787833778.601979:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:6161:x1874679381886080:12345-192.168.203.17@tcp:101: 00010000:00010000:3.0:1787833778.602001:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833778.602022:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247800/0x996d2fb20dc1d2d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ea34 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833778.602069:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247800/0x996d2fb20dc1d2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea34 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833778.602080:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247800/0x996d2fb20dc1d2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea34 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833778.602090:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247800, rc 0) 00000100:00100000:3.0:1787833778.602150:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6161:x1874679381886080:12345-192.168.203.17@tcp:101: Request processed in 172us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833778.602157:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 192 00000100:00100000:0.0:1787833778.608073:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833778.608410:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381886208 00000100:00100000:2.0:1787833778.608420:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381886208 00000100:00100000:2.0:1787833778.608496:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 193 00000100:00100000:2.0:1787833778.608506:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6161:x1874679381886208:12345-192.168.203.17@tcp:256: 20000000:01000000:2.0:1787833778.608531:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787833778.608556:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787833778.608560:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787833778.608563:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787833778.608567:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787833778.608570:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787833778.618978:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6161:x1874679381886208:12345-192.168.203.17@tcp:256: Request processed in 10460us (10902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833778.618995:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 193 00000100:00100000:0.0:1787833778.624852:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833778.625015:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381886336 00000100:00100000:1.0:1787833778.625036:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381886336 00000100:00100000:1.0:1787833778.625101:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 194 00000100:00100000:1.0:1787833778.625112:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6161:x1874679381886336:12345-192.168.203.17@tcp:101: 00010000:00010000:1.0:1787833778.625130:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833778.625147:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ea3b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833778.625184:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea3b expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833778.625195:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea3b expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833778.625204:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a600, rc 0) 00000100:00100000:1.0:1787833778.625268:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6161:x1874679381886336:12345-192.168.203.17@tcp:101: Request processed in 158us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833778.625275:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 194 00000100:00100000:0.0:1787833778.630352:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833778.630549:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381886464 00000100:00100000:2.0:1787833778.630585:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381886464 00000100:00100000:2.0:1787833778.630641:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 195 00000100:00100000:2.0:1787833778.630651:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6161:x1874679381886464:12345-192.168.203.17@tcp:501: 00000100:00100000:2.0:1787833778.630862:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6161:x1874679381886464:12345-192.168.203.17@tcp:501: Request processed in 211us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833778.630870:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 195 00000100:00100000:0.0:1787833778.634169:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833778.634431:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381886592 00000100:00100000:1.0:1787833778.634441:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381886592 00000100:00100000:1.0:1787833778.634500:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 196 00000100:00100000:1.0:1787833778.634511:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6161:x1874679381886592:12345-192.168.203.17@tcp:503: 00000100:00100000:1.0:1787833778.634674:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6161:x1874679381886592:12345-192.168.203.17@tcp:503: Request processed in 165us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833778.634694:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 196 00000100:00100000:0.0:1787833778.641365:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833778.641802:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381886720 00000100:00100000:3.0:1787833778.641815:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381886720 00000100:00100000:3.0:1787833778.641882:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 197 00000100:00100000:3.0:1787833778.641892:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6184:x1874679381886720:12345-192.168.203.17@tcp:502: 00000100:00100000:3.0:1787833778.642384:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6184:x1874679381886720:12345-192.168.203.17@tcp:502: Request processed in 493us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833778.642393:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 197 00000100:00100000:0.0:1787833778.648391:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833778.648491:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381886848 00000100:00100000:2.0:1787833778.648502:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381886848 00000100:00100000:2.0:1787833778.648571:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 198 00000100:00100000:2.0:1787833778.648581:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6184:x1874679381886848:12345-192.168.203.17@tcp:502: 00000100:00100000:2.0:1787833778.648784:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6184:x1874679381886848:12345-192.168.203.17@tcp:502: Request processed in 172us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833778.648792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 198 00000100:00100000:0.0:1787833778.652490:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833778.652534:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833778.652832:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381886976 00000100:00100000:3.0:1787833778.652841:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381886976 00000100:00100000:3.0:1787833778.652978:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381887232 00000100:00100000:3.0:1787833778.652982:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381887232 00000100:00100000:1.0:1787833778.654418:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:1.0:1787833778.654429:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1874679381886976:12345-192.168.203.17@tcp:38: 00010000:00080000:1.0:1787833778.654465:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1787833778.654525:0:6515:0:(genops.c:1385:class_connect()) connect: client a4724ace-a769-4adb-acca-a2bfbc389c92, cookie 0x996d2fb20dc1d2e6 00000004:00100000:1.0:1787833778.654553:0:6515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787833778.654926:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8df503f91800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833778.655008:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2397:x1874679381886976:12345-192.168.203.17@tcp:38: Request processed in 578us (2527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833778.655016:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:1.0:1787833778.655297:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:1.0:1787833778.655303:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1874679381887232:12345-192.168.203.17@tcp:38: 00010000:00080000:1.0:1787833778.655323:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1787833778.655374:0:6515:0:(genops.c:1385:class_connect()) connect: client a4724ace-a769-4adb-acca-a2bfbc389c92, cookie 0x996d2fb20dc1d2ed 00000004:00100000:1.0:1787833778.655388:0:6515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787833778.655524:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8df635a18800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833778.655551:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2397:x1874679381887232:12345-192.168.203.17@tcp:38: Request processed in 247us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833778.655557:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00010000:00010000:2.0:1787833778.967738:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833779.542771:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833779.542799:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406055680:0@lo:41: 00000100:00100000:2.0:1787833779.542877:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833779.543414:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406055680 00000100:00100000:3.0:1787833779.543423:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406055680 00000100:00100000:3.0:1787833779.543476:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787833779.543485:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406055680:12345-0@lo:41: 00000004:00000024:3.0:1787833779.543516:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833779.543577:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406055680:12345-0@lo:41: Request processed in 93us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833779.543584:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787833779.543796:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406055680:0@lo:41: 00000100:00100000:0.0:1787833779.659746:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833779.659830:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833779.659892:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381887104 00000100:00100000:2.0:1787833779.659904:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381887104 00000100:00100000:3.0:1787833779.659912:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381887488 00000100:00100000:3.0:1787833779.659918:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381887488 00000100:00100000:3.0:1787833779.659990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1787833779.660002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:6161:x1874679381887488:12345-192.168.203.17@tcp:41: 00000004:00000024:3.0:1787833779.660061:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787833779.660136:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:6161:x1874679381887488:12345-192.168.203.17@tcp:41: Request processed in 136us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833779.660144:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00080000:0.0:1787833779.660557:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833779.663595:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:2.0:1787833779.663637:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:0:x1874679381887104:12345-192.168.203.17@tcp:41: 00000004:00000024:2.0:1787833779.663669:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787833779.663747:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:0:x1874679381887104:12345-192.168.203.17@tcp:41: Request processed in 140us (4020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833779.663771:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1787833779.670042:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833779.670277:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381887360 00000100:00100000:1.0:1787833779.670290:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381887360 00000100:00100000:1.0:1787833779.670380:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:1.0:1787833779.670390:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:0:x1874679381887360:12345-192.168.203.17@tcp:41: 00000004:00000024:1.0:1787833779.670436:0:9772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787833779.670499:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:0:x1874679381887360:12345-192.168.203.17@tcp:41: Request processed in 111us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833779.670506:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00080000:2.0:1787833779.670871:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833779.678479:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833779.680451:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381887616 00000100:00100000:1.0:1787833779.680470:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381887616 00000100:00100000:1.0:1787833779.680558:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:1.0:1787833779.680570:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6161:x1874679381887616:12345-192.168.203.17@tcp:40: 00000100:00100000:1.0:1787833779.683993:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6161:x1874679381887616:12345-192.168.203.17@tcp:40: Request processed in 3414us (6050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833779.684008:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:1.0:1787833779.688325:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833779.688542:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381888000 00000100:00100000:3.0:1787833779.688553:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381888000 00000100:00100000:3.0:1787833779.688619:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1787833779.688630:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6161:x1874679381888000:12345-192.168.203.17@tcp:900: 00000100:00100000:3.0:1787833779.689413:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6161:x1874679381888000:12345-192.168.203.17@tcp:900: Request processed in 773us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833779.689424:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:0.0:1787833779.697616:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833779.697663:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833779.697722:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833779.697964:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381887744 00000100:00100000:2.0:1787833779.697973:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381887744 00000100:00100000:2.0:1787833779.698020:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381887872 00000100:00100000:2.0:1787833779.698024:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381887872 00000100:00100000:2.0:1787833779.698051:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1787833779.698058:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1874679381887744:12345-192.168.203.17@tcp:8: 00010000:00080000:2.0:1787833779.698091:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:2.0:1787833779.698121:0:8430:0:(genops.c:1385:class_connect()) connect: client a4724ace-a769-4adb-acca-a2bfbc389c92, cookie 0x996d2fb20dc1d2f4 00002000:00100000:2.0:1787833779.698132:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a4724ace-a769-4adb-acca-a2bfbc389c92/ffff8df5038a9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787833779.698148:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787833779.698586:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787833779.698618:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8df5038aa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833779.698908:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2397:x1874679381887744:12345-192.168.203.17@tcp:8: Request processed in 847us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833779.698917:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:3.0:1787833779.698954:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:3.0:1787833779.698962:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1874679381887872:12345-192.168.203.17@tcp:8: 00010000:00080000:3.0:1787833779.698998:0:8432:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp t0 exp 0000000000000000 cur 255 last 0 00000100:00100000:2.0:1787833779.699014:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381888128 00000100:00100000:2.0:1787833779.699020:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381888128 00000020:00000080:3.0:1787833779.699033:0:8432:0:(genops.c:1385:class_connect()) connect: client a4724ace-a769-4adb-acca-a2bfbc389c92, cookie 0x996d2fb20dc1d2fb 00002000:00100000:3.0:1787833779.699043:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a4724ace-a769-4adb-acca-a2bfbc389c92/ffff8df5039c6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787833779.699056:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787833779.699130:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 199 00000100:00100000:2.0:1787833779.699138:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2399:x1874679381888128:12345-192.168.203.17@tcp:400: 00002000:00080000:3.0:1787833779.699211:0:8432:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787833779.699231:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8df5039c0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833779.699248:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2399:x1874679381888128:12345-192.168.203.17@tcp:400: Request processed in 110us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833779.699255:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 199 00000100:00100000:3.0:1787833779.699267:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2397:x1874679381887872:12345-192.168.203.17@tcp:8: Request processed in 303us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833779.699276:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1787833779.705245:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833779.705915:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381888256 00000100:00100000:3.0:1787833779.705926:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381888256 00000100:00100000:3.0:1787833779.705992:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1787833779.706003:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6161:x1874679381888256:12345-192.168.203.17@tcp:33: 00000004:00080000:3.0:1787833779.747940:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 41544us 00000004:00200000:2.0:1787833779.791743:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787833779.791890:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6161:x1874679381888256:12345-192.168.203.17@tcp:33: Request processed in 85884us (86651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833779.791908:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00010000:00010000:3.0:1787833779.989983:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833780.037681:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833780.037870:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381888384 00000100:00100000:2.0:1787833780.037881:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381888384 00000100:00100000:2.0:1787833780.038011:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:2.0:1787833780.038023:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c459680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6202:x1874679381888384:12345-192.168.203.17@tcp:101: 00010000:00010000:2.0:1787833780.038043:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833780.038109:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d302 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ea6c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833780.038187:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d309 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833780.038202:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d309 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833780.038217:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d309 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833780.038265:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787833780.038270:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833780.038287:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d309 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833780.038316:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d302 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea6c expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833780.038336:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d309 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea6c expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833780.038344:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df62150b100) 00010000:00010000:2.0:1787833780.038347:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833780.038363:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e000, rc 0) 00000100:00100000:2.0:1787833780.038429:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c459680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:6202:x1874679381888384:12345-192.168.203.17@tcp:101: Request processed in 408us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833780.038436:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1787833780.054082:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833780.054121:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406055808:0@lo:13: 00000100:00100000:0.0:1787833780.054218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833780.054771:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406055808 00000100:00100000:2.0:1787833780.054779:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406055808 00000100:00100000:2.0:1787833780.054828:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787833780.054837:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406055808:12345-0@lo:13: 00002000:00000024:2.0:1787833780.054860:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833780.054903:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406055808:12345-0@lo:13: Request processed in 68us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833780.054909:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787833780.054984:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833780.055283:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406055936:0@lo:13: 00000100:00100000:0.0:1787833780.055332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787833780.055390:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f412c0 x1874679406055808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833780.055401:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787833780.055424:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406055808:0@lo:13: 00000100:00100000:2.0:1787833780.055695:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406055936 00000100:00100000:2.0:1787833780.055701:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406055936 00000100:00100000:2.0:1787833780.055747:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787833780.055779:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406055936:12345-0@lo:13: 00002000:00000024:2.0:1787833780.055793:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833780.055834:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406055936:12345-0@lo:13: Request processed in 56us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833780.055841:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787833780.056076:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406056064:0@lo:400: 00000100:00100000:2.0:1787833780.056110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833780.056134:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406056576:0@lo:400: 00000100:00100000:2.0:1787833780.056161:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833780.056191:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787833780.056197:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406056192:0@lo:400: 00000100:00100000:2.0:1787833780.056221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833780.056252:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406056704:0@lo:400: 00000100:00100000:2.0:1787833780.056274:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833780.056444:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406056448:0@lo:400: 00000100:00100000:0.0:1787833780.056620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833780.056640:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406056960:0@lo:400: 00000100:00100000:0.0:1787833780.056665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787833780.056696:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63c45a580 x1874679406055936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833780.056705:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787833780.056722:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c45a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406055936:0@lo:13: 00000100:00100000:0.0:1787833780.056734:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787833780.056739:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406056320:0@lo:400: 00000100:00100000:0.0:1787833780.056787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833780.056814:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406056832:0@lo:400: 00000100:00100000:0.0:1787833780.056836:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833780.056864:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406056960 00000100:00100000:0.0:1787833780.056869:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406056960 00000100:00100000:0.0:1787833780.056904:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406056832 00000100:00100000:0.0:1787833780.056907:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406056832 00000100:00100000:0.0:1787833780.056926:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787833780.056934:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406056960:12345-0@lo:400: 00000100:00100000:0.0:1787833780.056985:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406056960:12345-0@lo:400: Request processed in 52us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833780.056992:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787833780.057007:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787833780.057014:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406056832:12345-0@lo:400: 00000100:00100000:0.0:1787833780.057040:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406056832:12345-0@lo:400: Request processed in 27us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833780.057046:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787833780.057064:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406056320 00000100:00100000:0.0:1787833780.057068:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406056320 00000100:00100000:0.0:1787833780.057090:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787833780.057097:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406056320:12345-0@lo:400: 00000100:00100000:0.0:1787833780.057127:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406056320:12345-0@lo:400: Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833780.057132:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787833780.057157:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406056320:0@lo:400: 00010000:00080000:0.0:1787833780.057177:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6f0c0 x1874679406056832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833780.057187:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406056832:0@lo:400: 00010000:00080000:0.0:1787833780.057204:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6c000 x1874679406056960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833780.057211:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406056960:0@lo:400: 00000100:00100000:2.0:1787833780.057298:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406057088:0@lo:400: 00000100:00100000:2.0:1787833780.057339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833780.057357:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833780.057362:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406057216:0@lo:400: 00000100:00100000:2.0:1787833780.057381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833780.057399:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406056576 00000100:00100000:2.0:1787833780.057401:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406056576 00000100:00100000:2.0:1787833780.057421:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406056192 00000100:00100000:2.0:1787833780.057424:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406056192 00000100:00100000:2.0:1787833780.057451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406056704 00000100:00100000:2.0:1787833780.057453:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406056704 00000100:00100000:3.0:1787833780.057633:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406056064 00000100:00100000:3.0:1787833780.057638:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406056064 00000100:00100000:2.0:1787833780.057654:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406056448 00000100:00100000:2.0:1787833780.057658:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406056448 00000100:00100000:2.0:1787833780.057670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406057088 00000100:00100000:3.0:1787833780.057672:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787833780.057672:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406057088 00000100:00100000:3.0:1787833780.057678:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406056064:12345-0@lo:400: 00000100:00100000:2.0:1787833780.057682:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406057216 00000100:00100000:2.0:1787833780.057684:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406057216 00000100:00100000:2.0:1787833780.057697:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787833780.057702:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406056576:12345-0@lo:400: 00000100:00100000:3.0:1787833780.057717:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406056064:12345-0@lo:400: Request processed in 39us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833780.057723:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787833780.057730:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406056576:12345-0@lo:400: Request processed in 29us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833780.057736:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787833780.057746:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787833780.057773:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787833780.057773:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406056192:12345-0@lo:400: 00000100:00100000:3.0:1787833780.057779:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406056704:12345-0@lo:400: 00000100:00100000:3.0:1787833780.057802:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406056704:12345-0@lo:400: Request processed in 24us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833780.057802:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406056192:12345-0@lo:400: Request processed in 50us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833780.057807:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787833780.057815:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787833780.057823:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787833780.057828:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406056448:12345-0@lo:400: 00000100:00100000:0.0:1787833780.058345:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406056448:12345-0@lo:400: Request processed in 515us (1791us total) trans 0 rc 0/0 00000100:00080000:1.0:1787833780.058403:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833780.058409:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833780.058411:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833780.058413:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833780.063562:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787833780.063594:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406057088:12345-0@lo:400: 00000100:00100000:3.0:1787833780.063698:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406057088:12345-0@lo:400: Request processed in 122us (6356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833780.063706:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787833780.063744:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787833780.063767:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406057216:12345-0@lo:400: 00000100:00100000:3.0:1787833780.063801:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406057216:12345-0@lo:400: Request processed in 52us (6419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833780.063807:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787833780.063872:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6f840 x1874679406057216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833780.063888:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406057216:0@lo:400: 00000100:00100000:3.0:1787833780.063903:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406057088:0@lo:400: 00000100:00100000:3.0:1787833780.063917:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406056192:0@lo:400: 00010000:00080000:3.0:1787833780.063928:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6c780 x1874679406056704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833780.063936:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406056704:0@lo:400: 00000100:00100000:2.0:1787833780.064843:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406056448:0@lo:400: 00000100:00100000:3.0:1787833780.068469:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406056064:0@lo:400: 00000100:00100000:3.0:1787833780.068600:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406056576:0@lo:400: 00000100:00100000:0.0:1787833780.071974:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1787833781.014191:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833781.084787:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833781.084815:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406057344:0@lo:41: 00000100:00100000:1.0:1787833781.084898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833781.084937:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406057344 00000100:00100000:0.0:1787833781.084945:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406057344 00000100:00100000:0.0:1787833781.084988:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787833781.084997:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406057344:12345-0@lo:41: 00000004:00000024:0.0:1787833781.085031:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787833781.085086:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406057344:12345-0@lo:41: Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833781.085093:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787833781.085313:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406057344:0@lo:41: 00010000:00010000:2.0:1787833782.038537:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833782.614053:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833782.614400:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406057472:0@lo:13: 00000100:00100000:3.0:1787833782.614491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833782.614592:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833782.614613:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406057600:0@lo:13: 00000100:00100000:1.0:1787833782.614647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833782.634702:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406057472 00000100:00100000:2.0:1787833782.634717:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406057472 00000100:00080000:1.0:1787833782.634787:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833782.634797:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406057600 00000100:00100000:2.0:1787833782.634801:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406057600 00000100:00100000:2.0:1787833782.634824:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787833782.634833:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406057472:12345-0@lo:13: 00002000:00000024:2.0:1787833782.634865:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833782.634952:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406057472:12345-0@lo:13: Request processed in 121us (20461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833782.634958:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787833782.634973:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787833782.634979:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c4592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406057600:12345-0@lo:13: 00002000:00000024:2.0:1787833782.634989:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833782.635019:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c4592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406057600:12345-0@lo:13: Request processed in 41us (20372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833782.635024:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787833782.635248:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6c000 x1874679406057600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833782.635274:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406057600:0@lo:13: 00010000:00080000:3.0:1787833782.635372:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f430c0 x1874679406057472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833782.635387:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406057472:0@lo:13: 00000100:00100000:0.0:1787833782.646345:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833782.646415:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381888512 00000100:00100000:3.0:1787833782.646425:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381888512 00000100:00100000:3.0:1787833782.646524:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:3.0:1787833782.646537:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:6254:x1874679381888512:12345-192.168.203.17@tcp:41: 00000004:00000024:3.0:1787833782.646580:0:9772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787833782.646660:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:6254:x1874679381888512:12345-192.168.203.17@tcp:41: Request processed in 126us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833782.646668:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00080000:1.0:1787833782.647403:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833782.649372:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833782.649475:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381888640 00000100:00100000:0.0:1787833782.649486:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381888640 00000100:00100000:0.0:1787833782.649574:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:0.0:1787833782.649585:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6254:x1874679381888640:12345-192.168.203.17@tcp:41: 00000004:00000024:0.0:1787833782.649632:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787833782.649715:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6254:x1874679381888640:12345-192.168.203.17@tcp:41: Request processed in 131us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833782.649723:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00080000:1.0:1787833782.649832:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833782.655698:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833782.655805:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381888768 00000100:00100000:1.0:1787833782.655814:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381888768 00000100:00080000:2.0:1787833782.655990:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833782.656187:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:1.0:1787833782.656198:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6254:x1874679381888768:12345-192.168.203.17@tcp:13: 00002000:00000024:1.0:1787833782.656225:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833782.656294:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6254:x1874679381888768:12345-192.168.203.17@tcp:13: Request processed in 97us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833782.656302:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:3.0:1787833782.664317:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833782.666228:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381888896 00000100:00100000:1.0:1787833782.666245:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381888896 00000100:00100000:1.0:1787833782.666340:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:1.0:1787833782.666353:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6254:x1874679381888896:12345-192.168.203.17@tcp:13: 00002000:00000024:1.0:1787833782.666385:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833782.666475:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a4724ace-a769-4adb-acca-a2bfbc389c92+6:6254:x1874679381888896:12345-192.168.203.17@tcp:13: Request processed in 125us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833782.666483:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00080000:2.0:1787833782.668058:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787833783.064276:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833784.088529:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787833784.154103:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000001:00100000:2.0:1787833784.171170:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000001:00100000:2.0:1787833784.174108:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000100:00100000:1.0:1787833784.662091:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406057728:0@lo:41: 00000100:00100000:1.0:1787833784.662176:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833784.666803:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406057728 00000100:00100000:3.0:1787833784.666816:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406057728 00000100:00100000:3.0:1787833784.666883:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787833784.666893:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406057728:12345-0@lo:41: 00000004:00000024:3.0:1787833784.666930:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833784.668036:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406057728:12345-0@lo:41: Request processed in 1139us (5855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833784.668046:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787833784.669149:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406057728:0@lo:41: 00000100:00100000:3.0:1787833784.887066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833784.887110:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833784.887166:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833784.887181:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381889280 00000100:00100000:1.0:1787833784.887203:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381889280 00000100:00100000:3.0:1787833784.887206:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833784.887240:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833784.887271:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381889536 00000100:00100000:3.0:1787833784.887276:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381889536 00000100:00100000:1.0:1787833784.887283:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381889152 00000100:00100000:1.0:1787833784.887289:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381889152 00000100:00100000:3.0:1787833784.887320:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381889408 00000100:00100000:3.0:1787833784.887324:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381889408 00000100:00100000:1.0:1787833784.887329:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:1.0:1787833784.887342:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381889280:12345-192.168.203.17@tcp:400: 00000100:00100000:3.0:1787833784.887356:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1787833784.887366:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381889536:12345-192.168.203.17@tcp:400: 00000100:00100000:1.0:1787833784.887498:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381889280:12345-192.168.203.17@tcp:400: Request processed in 159us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833784.887507:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:1.0:1787833784.887525:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1787833784.887532:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2398:x1874679381889152:12345-192.168.203.17@tcp:400: 00000100:00100000:3.0:1787833784.887871:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381889536:12345-192.168.203.17@tcp:400: Request processed in 505us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833784.887879:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1787833784.887897:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:3.0:1787833784.887905:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2398:x1874679381889408:12345-192.168.203.17@tcp:400: 00000100:00100000:3.0:1787833784.887933:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2398:x1874679381889408:12345-192.168.203.17@tcp:400: Request processed in 30us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833784.887940:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:2.0:1787833784.888076:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381889024 00000100:00100000:2.0:1787833784.888083:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381889024 00000100:00100000:2.0:1787833784.888115:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 201 00000100:00100000:2.0:1787833784.888122:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2398:x1874679381889024:12345-192.168.203.17@tcp:400: 00000100:00100000:2.0:1787833784.888160:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2398:x1874679381889024:12345-192.168.203.17@tcp:400: Request processed in 39us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833784.888167:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 201 00000100:00080000:0.0:1787833784.888362:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833784.888367:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833784.888376:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833784.888378:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787833784.889483:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2398:x1874679381889152:12345-192.168.203.17@tcp:400: Request processed in 1942us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833784.889495:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00010000:00010000:2.0:1787833785.117283:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833785.174015:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406057856:0@lo:13: 00000100:00100000:0.0:1787833785.174104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833785.174174:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833785.174181:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406057984:0@lo:13: 00000100:00100000:0.0:1787833785.174207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833785.174247:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406057856 00000100:00100000:0.0:1787833785.174253:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406057856 00000100:00100000:0.0:1787833785.174296:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406057984 00000100:00100000:0.0:1787833785.174299:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406057984 00000100:00100000:0.0:1787833785.174316:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787833785.174324:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406057856:12345-0@lo:13: 00002000:00000024:0.0:1787833785.174354:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833785.174396:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406057856:12345-0@lo:13: Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833785.174404:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787833785.174420:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787833785.174426:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406057984:12345-0@lo:13: 00002000:00000024:0.0:1787833785.174435:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833785.174458:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406057984:12345-0@lo:13: Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833785.174464:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787833785.174477:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833785.174578:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406058112:0@lo:400: 00000100:00100000:0.0:1787833785.174611:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833785.174643:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406058624:0@lo:400: 00000100:00100000:0.0:1787833785.174677:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833785.174695:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406059136:0@lo:400: 00000100:00100000:0.0:1787833785.174716:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833785.174735:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787833785.174739:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406058240:0@lo:400: 00000100:00100000:2.0:1787833785.175034:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406058112 00000100:00100000:0.0:1787833785.175037:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833785.175038:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406058112 00000100:00100000:0.0:1787833785.175058:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406058752:0@lo:400: 00000100:00100000:2.0:1787833785.175079:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787833785.175080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833785.175086:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406058112:12345-0@lo:400: 00000100:00100000:0.0:1787833785.175094:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406059264:0@lo:400: 00000100:00100000:0.0:1787833785.175113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833785.175119:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406058112:12345-0@lo:400: Request processed in 34us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833785.175126:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787833785.175147:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406058112:0@lo:400: 00000100:00100000:2.0:1787833785.175173:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406058240 00000100:00100000:2.0:1787833785.175177:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406058240 00000100:00100000:2.0:1787833785.175201:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406058752 00000100:00100000:2.0:1787833785.175204:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406058752 00000100:00100000:0.0:1787833785.175218:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406058624 00000100:00100000:0.0:1787833785.175221:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406058624 00000100:00100000:0.0:1787833785.175246:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787833785.175253:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406058624:12345-0@lo:400: 00000100:00100000:0.0:1787833785.175303:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406058624:12345-0@lo:400: Request processed in 50us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833785.175310:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787833785.175329:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406059136 00000100:00100000:0.0:1787833785.175333:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406059136 00000100:00100000:0.0:1787833785.175361:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787833785.175367:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406059136:12345-0@lo:400: 00000100:00100000:0.0:1787833785.175396:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406059136:12345-0@lo:400: Request processed in 30us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833785.175402:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787833785.175418:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406059264 00000100:00100000:0.0:1787833785.175426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406059264 00000100:00100000:0.0:1787833785.175446:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787833785.175452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406058240:12345-0@lo:400: 00000100:00100000:0.0:1787833785.175481:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406058240:12345-0@lo:400: Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833785.175847:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406058496:0@lo:400: 00000100:00100000:1.0:1787833785.175881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833785.175898:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406059008:0@lo:400: 00000100:00100000:1.0:1787833785.175920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833785.175939:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787833785.175946:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406058368:0@lo:400: 00000100:00100000:1.0:1787833785.175968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833785.176008:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406058880:0@lo:400: 00000100:00100000:1.0:1787833785.176037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833785.176049:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406059392:0@lo:400: 00000100:00100000:1.0:1787833785.176077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833785.176097:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406058496 00000100:00100000:1.0:1787833785.176101:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406058496 00000100:00100000:2.0:1787833785.176608:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406058880 00000100:00100000:2.0:1787833785.176614:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406058880 00000100:00100000:2.0:1787833785.176632:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406059392 00000100:00100000:2.0:1787833785.176635:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406059392 00000100:00100000:2.0:1787833785.176650:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787833785.176658:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406059264:12345-0@lo:400: 00000100:00100000:2.0:1787833785.176724:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406059264:12345-0@lo:400: Request processed in 67us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833785.176731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787833785.176766:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787833785.176773:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406058752:12345-0@lo:400: 00000100:00100000:2.0:1787833785.176803:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406058752:12345-0@lo:400: Request processed in 31us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833785.176810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787833785.176822:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787833785.176827:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406058880:12345-0@lo:400: 00000100:00100000:2.0:1787833785.176859:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406058880:12345-0@lo:400: Request processed in 32us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833785.176864:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787833785.176875:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787833785.176881:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406059392:12345-0@lo:400: 00000100:00100000:2.0:1787833785.176905:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406059392:12345-0@lo:400: Request processed in 25us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833785.176910:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1787833785.177499:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0c3c0 x1874679406058880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833785.177514:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406058880:0@lo:400: 00010000:00080000:2.0:1787833785.177526:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0e580 x1874679406059392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833785.177535:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406059392:0@lo:400: 00000100:00100000:2.0:1787833785.177914:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406059008 00000100:00100000:2.0:1787833785.177922:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406059008 00000100:00100000:2.0:1787833785.177969:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787833785.177988:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406059008:12345-0@lo:400: 00000100:00100000:2.0:1787833785.178068:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406059008:12345-0@lo:400: Request processed in 92us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833785.178360:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787833785.178426:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0cf00 x1874679406059008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833785.178438:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406059008:0@lo:400: 00000100:00100000:0.0:1787833785.178650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1787833785.178685:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833785.178691:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833785.178694:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833785.178871:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406058368 00000100:00100000:3.0:1787833785.178877:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406058368 00000100:00100000:3.0:1787833785.178921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787833785.178929:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406058368:12345-0@lo:400: 00000100:00100000:0.0:1787833785.178982:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406058240:0@lo:400: 00000100:00100000:3.0:1787833785.178993:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406058368:12345-0@lo:400: Request processed in 66us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833785.178994:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406058752:0@lo:400: 00000100:00100000:3.0:1787833785.178999:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787833785.179006:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406059264:0@lo:400: 00000100:00100000:0.0:1787833785.179017:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406058624:0@lo:400: 00010000:00080000:0.0:1787833785.179030:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0da40 x1874679406059136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833785.179039:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406059136:0@lo:400: 00000100:00100000:3.0:1787833785.179048:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406058368:0@lo:400: 00000100:00100000:1.0:1787833785.180817:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787833785.180834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406058496:12345-0@lo:400: 00000100:00100000:1.0:1787833785.180915:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406058496:12345-0@lo:400: Request processed in 88us (5033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833785.180921:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1787833785.180967:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6e940 x1874679406057984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833785.181274:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406057984:0@lo:13: 00010000:00080000:1.0:1787833785.181292:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6c000 x1874679406057856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833785.181305:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406057856:0@lo:13: 00000100:00100000:0.0:1787833785.181735:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406058496:0@lo:400: 00000001:00100000:3.0:1787833785.191910:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000001:02000400:0.0:1787833785.623447:0:10183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787833786.134637:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833786.198232:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406059520:0@lo:41: 00000100:00100000:0.0:1787833786.198304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833786.198546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406059520 00000100:00100000:1.0:1787833786.198555:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406059520 00000100:00100000:1.0:1787833786.198608:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787833786.198617:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406059520:12345-0@lo:41: 00000004:00000024:1.0:1787833786.198647:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787833786.198709:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406059520:12345-0@lo:41: Request processed in 93us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833786.198716:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787833786.198777:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406059520:0@lo:41: 00010000:00010000:2.0:1787833787.158942:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833787.735523:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833787.735550:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406059648:0@lo:13: 00000100:00100000:2.0:1787833787.735617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833787.735684:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406059648 00000100:00100000:2.0:1787833787.735691:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406059648 00000100:00100000:2.0:1787833787.735747:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787833787.735776:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406059648:12345-0@lo:13: 00002000:00000024:2.0:1787833787.735806:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833787.735850:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f41680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406059648:12345-0@lo:13: Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833787.735857:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787833787.735897:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f430c0 x1874679406059648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833787.735916:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406059648:0@lo:13: 00000100:00080000:0.0:1787833787.736387:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833787.739582:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833787.739611:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406059776:0@lo:13: 00000100:00100000:0.0:1787833787.739687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833787.740867:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406059776 00000100:00100000:0.0:1787833787.740896:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406059776 00000100:00100000:0.0:1787833787.740958:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787833787.740967:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406059776:12345-0@lo:13: 00002000:00000024:0.0:1787833787.740992:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833787.741049:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406059776:12345-0@lo:13: Request processed in 83us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833787.741057:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787833787.741080:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833787.741110:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0e1c0 x1874679406059776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833787.741140:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406059776:0@lo:13: 00010000:00010000:2.0:1787833788.185885:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833789.206821:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787833789.722415:0:10331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb5ea9d40 20000000:00000080:2.0:1787833789.722442:0:10331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df50383d400 uarg=0000000000000000 20000000:01000000:2.0:1787833789.722833:0:10331:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787833789.722835:0:10331:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787833789.722852:0:10331:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787833789.722857:0:10331:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787833789.722862:0:10331:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787833789.722934:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787833789.722937:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787833789.726052:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1787833789.726408:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1787833789.726437:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1787833789.726451:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1787833789.726461:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787833789.726464:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787833789.726943:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1787833789.727431:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1787833789.727458:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1787833789.727472:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1787833789.727486:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787833789.727488:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787833789.728499:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787833789.728937:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787833789.728964:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787833789.728978:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1787833789.728988:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787833789.728990:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787833789.731287:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787833789.731508:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787833789.731538:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787833789.731555:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1787833789.731565:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787833789.731567:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787833789.731934:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1787833789.732048:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1787833789.732069:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1787833789.732406:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:2.0:1787833789.732424:0:10331:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787833789.732444:0:10331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732462:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d1a4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732470:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d1ce expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732491:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d20d expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732498:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d21b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732504:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d229 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732510:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d245 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732517:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d26f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732524:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d28b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732531:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d2b5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732541:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91e9fc expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732549:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea03 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732556:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732607:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea03 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732624:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea03 expref: 9 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.732638:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406059904:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833789.732811:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91e9fc expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732820:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91e9fc expref: 9 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.732827:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060032:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833789.732870:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d2b5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732878:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d2b5 expref: 23 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.732888:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060160:0@lo:104: 00000100:00100000:2.0:1787833789.732936:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833789.732966:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d28b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.732973:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d28b expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.732993:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060288:0@lo:104: 00000100:00100000:2.0:1787833789.733018:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833789.733068:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d26f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.733076:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d26f expref: 23 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.733096:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504484b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060416:0@lo:104: 00000100:00100000:2.0:1787833789.733128:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833789.734375:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d245 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.734391:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d245 expref: 23 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.734403:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044843c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060544:0@lo:104: 00000100:00100000:2.0:1787833789.734446:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833789.736613:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d229 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.736632:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d229 expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.736648:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504484f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060672:0@lo:104: 00010000:00010000:2.0:1787833789.736699:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d21b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.736727:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d21b expref: 23 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.736736:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060800:0@lo:104: 00010000:00010000:2.0:1787833789.736790:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d20d expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.736798:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d20d expref: 23 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.736889:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060928:0@lo:104: 00010000:00010000:2.0:1787833789.736919:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d1ce expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.736926:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1ce expref: 23 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.736933:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406061056:0@lo:104: 00010000:00010000:2.0:1787833789.736958:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d1a4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.736965:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1a4 expref: 23 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.736973:0:10331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406061184:0@lo:104: 00000100:00100000:2.0:1787833789.736990:0:10331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504460300 going to sleep for 11 seconds 00000100:00100000:0.0:1787833789.740965:0:9520:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787833789.741027:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.741062:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.741073:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.741084:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.741095:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.741119:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406060160 00000100:00100000:0.0:1787833789.741128:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406060160 00000100:00100000:0.0:1787833789.741178:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406060288 00000100:00100000:0.0:1787833789.741181:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406060288 00000100:00100000:0.0:1787833789.741192:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406060416 00000100:00100000:0.0:1787833789.741194:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406060416 00000100:00100000:0.0:1787833789.741205:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406060544 00000100:00100000:0.0:1787833789.741207:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406060544 00000100:00100000:0.0:1787833789.741216:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406060672 00000100:00100000:0.0:1787833789.741218:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406060672 00000100:00100000:0.0:1787833789.741241:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406060800 00000100:00100000:0.0:1787833789.741244:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406060800 00000100:00100000:0.0:1787833789.741252:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406060928 00000100:00100000:0.0:1787833789.741254:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406060928 00000100:00100000:0.0:1787833789.741262:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406061056 00000100:00100000:0.0:1787833789.741264:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406061056 00000100:00100000:0.0:1787833789.741271:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406061184 00000100:00100000:0.0:1787833789.741273:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406061184 00000100:00100000:0.0:1787833789.741284:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787833789.741292:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:10331:x1874679406060160:12345-0@lo:104: 00010000:00010000:0.0:1787833789.741323:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833789.741439:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833789.741445:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+11:10331:x1874679406060160:12345-0@lo:104: Request processed in 154us (8509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833789.741452:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787833789.743137:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060160:0@lo:104: 00000100:00100000:1.0:1787833789.743787:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1787833789.743817:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787833789.743840:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:10331:x1874679406060288:12345-0@lo:104: 00010000:00010000:0.0:1787833789.743861:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833789.744029:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787833789.744030:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060288:0@lo:104: 00000100:00100000:0.0:1787833789.744035:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:10331:x1874679406060288:12345-0@lo:104: Request processed in 207us (11016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.744191:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833789.744203:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:10331:x1874679406060416:12345-0@lo:104: 00010000:00010000:3.0:1787833789.744212:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.744254:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787833789.744259:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+10:10331:x1874679406060416:12345-0@lo:104: Request processed in 61us (11131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.744265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833789.744297:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787833789.744304:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:10331:x1874679406060544:12345-0@lo:104: 00010000:00010000:3.0:1787833789.744311:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.744480:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504484b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060416:0@lo:104: 00010000:00010000:3.0:1787833789.746528:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787833789.746546:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+9:10331:x1874679406060544:12345-0@lo:104: Request processed in 2238us (12094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.746558:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787833789.746595:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787833789.746606:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+8:10331:x1874679406060672:12345-0@lo:104: 00010000:00010000:3.0:1787833789.746640:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.746695:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787833789.746700:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+8:10331:x1874679406060672:12345-0@lo:104: Request processed in 99us (5678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.746707:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787833789.746722:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787833789.746729:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+7:10331:x1874679406060800:12345-0@lo:104: 00010000:00010000:3.0:1787833789.746737:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.746784:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787833789.746789:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+7:10331:x1874679406060800:12345-0@lo:104: Request processed in 62us (5727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.746796:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787833789.746826:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833789.746834:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:10331:x1874679406060928:12345-0@lo:104: 00010000:00010000:3.0:1787833789.746842:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.746873:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787833789.746878:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:10331:x1874679406060928:12345-0@lo:104: Request processed in 46us (5804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.746883:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833789.746897:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833789.746903:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:10331:x1874679406061056:12345-0@lo:104: 00010000:00010000:3.0:1787833789.746917:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.746947:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1787833789.746953:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:10331:x1874679406061056:12345-0@lo:104: Request processed in 50us (5868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.746959:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833789.746973:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787833789.746979:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:10331:x1874679406061184:12345-0@lo:104: 00010000:00010000:3.0:1787833789.746986:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.747008:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1787833789.747013:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:10331:x1874679406061184:12345-0@lo:104: Request processed in 35us (5918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.747018:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787833789.747132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833789.747225:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:3.0:1787833789.747245:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1787833789.747251:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.747259:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833789.747263:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.747272:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833789.747290:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833789.747296:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833789.748441:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.748454:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833789.748480:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.748958:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4f600/0x996d2fb20dc1d2b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d2bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.748976:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1787833789.748980:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.748986:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3bc00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833789.748989:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.748998:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833789.749005:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833789.749010:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833789.749054:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749059:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833789.749066:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749071:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df503c3bc00/0x996d2fb20dc1d28b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d292 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749079:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787833789.749161:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749167:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fa00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833789.749170:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749177:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833789.749182:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833789.749187:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833789.749200:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749206:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833789.749231:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749248:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d26f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d276 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749258:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787833789.749261:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749266:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833789.749269:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749276:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833789.749282:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833789.749287:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833789.749300:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749305:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833789.749309:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749316:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031200/0x996d2fb20dc1d245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d24c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749325:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:2.0:1787833789.749509:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406059904:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833789.749522:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060032:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833789.749531:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044843c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060544:0@lo:104: 00000100:00100000:2.0:1787833789.749538:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504484f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060672:0@lo:104: 00000100:00100000:2.0:1787833789.749545:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060800:0@lo:104: 00000100:00100000:2.0:1787833789.749552:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406060928:0@lo:104: 00000100:00100000:2.0:1787833789.749559:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406061056:0@lo:104: 00000100:00100000:2.0:1787833789.749565:0:10331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1874679406061184:0@lo:104: 00010000:00010000:2.0:1787833789.749604:0:10331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749708:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749715:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833789.749718:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749724:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833789.749730:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833789.749735:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833789.749907:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749913:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833789.749918:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749924:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031c00/0x996d2fb20dc1d229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d230 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749935:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787833789.749938:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749944:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fda00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833789.749946:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.749964:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833789.749970:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833789.749975:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787833789.751515:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406061312:0@lo:103: 00000100:00100000:2.0:1787833789.751602:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833789.751662:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406061824:0@lo:103: 00000100:00100000:2.0:1787833789.751685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833789.751715:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833789.751722:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406061440:0@lo:103: 00000100:00100000:2.0:1787833789.751741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833789.751785:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381889792 00000100:00100000:2.0:1787833789.751792:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381889792 00010000:00010000:2.0:1787833789.751845:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91e9fc expref: 10 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.751865:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381889664 00000100:00100000:2.0:1787833789.751880:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381889664 00010000:00010000:2.0:1787833789.751894:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea03 expref: 11 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.751907:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406061312 00000100:00100000:2.0:1787833789.751910:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406061312 00010000:00010000:2.0:1787833789.751922:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d2b5 expref: 24 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.751932:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406061824 00000100:00100000:2.0:1787833789.751934:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406061824 00010000:00010000:2.0:1787833789.751945:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d229 expref: 25 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.751955:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406061440 00000100:00100000:2.0:1787833789.751957:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406061440 00010000:00010000:2.0:1787833789.751967:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d28b expref: 26 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833789.751981:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1787833789.751988:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e167850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:2400:x1874679381889792:12345-192.168.203.17@tcp:103: 00010000:00010000:2.0:1787833789.752002:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833789.752007:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91e9fc expref: 11 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.752018:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91e9fc expref: 11 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.752037:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d2ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91e9fc expref: 11 pid: 6507 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.752061:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833789.752116:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e167850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2400:x1874679381889792:12345-192.168.203.17@tcp:103: Request processed in 127us (4985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.752124:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1787833789.752165:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:2.0:1787833789.752171:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:2400:x1874679381889664:12345-192.168.203.17@tcp:103: 00010000:00010000:2.0:1787833789.752179:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833789.752183:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea03 expref: 9 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.752193:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea03 expref: 9 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.752209:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d2d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea03 expref: 9 pid: 6506 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.752219:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833789.752238:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:2400:x1874679381889664:12345-192.168.203.17@tcp:103: Request processed in 67us (5013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.752244:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:2.0:1787833789.752256:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787833789.752263:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504485680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+26:3638:x1874679406061312:12345-0@lo:103: 00010000:00010000:2.0:1787833789.752272:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833789.752276:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d2b5 expref: 26 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.752296:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d2b5 expref: 26 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.752307:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b247200/0x996d2fb20dc1d2bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d2b5 expref: 26 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.752315:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833789.752728:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787833789.752738:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504486580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+25:3638:x1874679406061824:12345-0@lo:103: 00010000:00010000:1.0:1787833789.752748:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833789.752777:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d229 expref: 25 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.752794:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d229 expref: 25 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.752823:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1d230 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d229 expref: 25 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.752835:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833789.753230:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753240:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833789.753258:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753266:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6013fda00/0x996d2fb20dc1d21b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d222 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753280:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787833789.753284:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753290:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833789.753294:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753302:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833789.753309:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833789.753323:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833789.753414:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753421:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833789.753425:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753432:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600030200/0x996d2fb20dc1d20d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d214 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753443:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833789.753445:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753452:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833789.753455:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753461:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833789.753467:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833789.753472:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833789.753561:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753569:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833789.753581:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753587:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6013fc600/0x996d2fb20dc1d1ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d1d5 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753598:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833789.753601:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753607:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833789.753610:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753617:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833789.753624:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833789.753630:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833789.753644:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753650:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833789.753656:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753662:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b246a00/0x996d2fb20dc1d1a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d1ab expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833789.753676:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833789.753683:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833789.753685:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833789.753705:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406061952:0@lo:103: 00000100:00100000:1.0:1787833789.754009:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504486580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406061824:12345-0@lo:103: Request processed in 1270us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.754019:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787833789.754055:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787833789.754065:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3638:x1874679406061440:12345-0@lo:103: 00010000:00010000:1.0:1787833789.754076:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833789.754081:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d28b expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.754093:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d28b expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.754115:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d292 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d28b expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.754127:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833789.754156:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:3638:x1874679406061440:12345-0@lo:103: Request processed in 95us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.754161:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787833789.754253:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504485680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3638:x1874679406061312:12345-0@lo:103: Request processed in 1989us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.754260:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833789.754434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833789.754529:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833789.754537:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406062336:0@lo:103: 00000100:00100000:3.0:1787833789.754565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833789.754778:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406061952 00000100:00100000:1.0:1787833789.754787:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406061952 00010000:00010000:1.0:1787833789.754970:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d21b expref: 21 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833789.754995:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406062336 00000100:00100000:1.0:1787833789.754998:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406062336 00010000:00010000:1.0:1787833789.755009:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1a4 expref: 22 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833789.755022:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787833789.755028:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:3639:x1874679406061952:12345-0@lo:103: 00010000:00010000:1.0:1787833789.755039:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833789.755042:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d21b expref: 22 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.755052:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d21b expref: 22 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.755066:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031600/0x996d2fb20dc1d222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d21b expref: 22 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.755078:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833789.755123:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3639:x1874679406061952:12345-0@lo:103: Request processed in 95us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.755129:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787833789.755145:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787833789.755150:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3639:x1874679406062336:12345-0@lo:103: 00010000:00010000:1.0:1787833789.755157:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833789.755161:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1a4 expref: 20 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.755178:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1a4 expref: 20 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.755187:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f400/0x996d2fb20dc1d1ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d1a4 expref: 20 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.755196:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833789.755219:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3639:x1874679406062336:12345-0@lo:103: Request processed in 69us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.755225:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833789.755643:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406062336:0@lo:103: 00000100:00100000:3.0:1787833789.755656:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406061952:0@lo:103: 00000100:00100000:3.0:1787833789.755692:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406061440:0@lo:103: 00000100:00100000:3.0:1787833789.755703:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406061312:0@lo:103: 00000100:00100000:3.0:1787833789.755711:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406061824:0@lo:103: 00010000:00010000:1.0:1787833789.755970:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833789.755977:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833789.756282:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787833789.756405:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406061568:0@lo:103: 00000100:00100000:0.0:1787833789.756474:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.756631:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406062080:0@lo:103: 00000100:00100000:0.0:1787833789.756675:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.756786:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787833789.756794:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406061696:0@lo:103: 00000100:00100000:0.0:1787833789.757048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833789.757087:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406061568 00000100:00100000:1.0:1787833789.757094:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406061568 00010000:00010000:1.0:1787833789.757140:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d26f expref: 19 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833789.757171:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406062080 00000100:00100000:1.0:1787833789.757175:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406062080 00010000:00010000:1.0:1787833789.757187:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d20d expref: 20 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833789.757203:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787833789.757210:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e166c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3640:x1874679406061568:12345-0@lo:103: 00010000:00010000:1.0:1787833789.757224:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833789.757229:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d26f expref: 20 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.757242:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d26f expref: 20 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.757271:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b247c00/0x996d2fb20dc1d276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d26f expref: 20 pid: 6507 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.757285:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833789.757320:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e166c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3640:x1874679406061568:12345-0@lo:103: Request processed in 110us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.757336:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787833789.757375:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787833789.757381:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3640:x1874679406062080:12345-0@lo:103: 00010000:00010000:1.0:1787833789.757389:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833789.757393:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d20d expref: 18 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.757401:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d20d expref: 18 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.757410:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1d214 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d20d expref: 18 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.757418:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833789.757441:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:3640:x1874679406062080:12345-0@lo:103: Request processed in 60us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.757447:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787833789.757723:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406062208:0@lo:103: 00000100:00100000:1.0:1787833789.758252:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406061696 00000100:00100000:1.0:1787833789.758259:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406061696 00010000:00010000:1.0:1787833789.758281:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d245 expref: 17 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833789.758419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.758696:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406061568:0@lo:103: 00000100:00100000:0.0:1787833789.758708:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406062080:0@lo:103: 00000100:00100000:1.0:1787833789.758969:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406062208 00000100:00100000:1.0:1787833789.758983:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406062208 00010000:00010000:1.0:1787833789.759000:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1ce expref: 18 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833789.759025:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787833789.759034:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:3640:x1874679406061696:12345-0@lo:103: 00010000:00010000:1.0:1787833789.759045:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833789.759050:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d245 expref: 18 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759062:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d245 expref: 18 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759077:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d24c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d245 expref: 18 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759088:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833789.759137:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:3640:x1874679406061696:12345-0@lo:103: Request processed in 104us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.759144:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787833789.759159:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787833789.759165:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:3640:x1874679406062208:12345-0@lo:103: 00010000:00010000:1.0:1787833789.759172:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833789.759177:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1ce expref: 16 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759185:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1ce expref: 16 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759194:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d1d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d1ce expref: 16 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759210:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759219:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759234:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759240:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759246:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759253:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759258:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787833789.759262:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759270:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759285:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833789.759295:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833789.759321:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3640:x1874679406062208:12345-0@lo:103: Request processed in 156us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.759347:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1787833789.761193:0:10331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.761214:0:10331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.761223:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d310 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833789.761870:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406061696:0@lo:103: 00000100:00100000:1.0:1787833789.761883:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406062208:0@lo:103: 00000100:00100000:2.0:1787833789.781959:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833789.781987:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406062464:0@lo:41: 00000100:00100000:2.0:1787833789.782117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833789.782163:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406062464 00000100:00100000:2.0:1787833789.782169:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406062464 00000100:00100000:2.0:1787833789.782215:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787833789.782223:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504484f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406062464:12345-0@lo:41: 00000004:00000024:2.0:1787833789.782257:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833789.782301:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504484f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406062464:12345-0@lo:41: Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.782316:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787833789.782472:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406062464:0@lo:41: 00000100:00100000:3.0:1787833790.008120:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833790.008256:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381889920 00000100:00100000:2.0:1787833790.008268:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381889920 00000100:00100000:2.0:1787833790.008330:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 203 00000100:00100000:2.0:1787833790.008340:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:2399:x1874679381889920:12345-192.168.203.17@tcp:400: 00000100:00100000:2.0:1787833790.008457:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:2399:x1874679381889920:12345-192.168.203.17@tcp:400: Request processed in 118us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.008467:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 203 00000100:00100000:2.0:1787833790.008533:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833790.008726:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833790.008784:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833790.008834:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381890304 00000100:00100000:1.0:1787833790.008841:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381890304 00000100:00100000:1.0:1787833790.008892:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:1.0:1787833790.008900:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381890304:12345-192.168.203.17@tcp:400: 00000100:00100000:0.0:1787833790.009589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381890048 00000100:00100000:0.0:1787833790.009596:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381890048 00000100:00100000:0.0:1787833790.009643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381890176 00000100:00100000:0.0:1787833790.009646:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381890176 00000100:00100000:0.0:1787833790.009672:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:0.0:1787833790.009680:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381890048:12345-192.168.203.17@tcp:400: 00000100:00100000:1.0:1787833790.012094:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381890304:12345-192.168.203.17@tcp:400: Request processed in 3184us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833790.012119:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00080000:1.0:1787833790.012165:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833790.012171:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833790.012174:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833790.012196:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:1.0:1787833790.012212:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504484b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381890176:12345-192.168.203.17@tcp:400: 00000100:00100000:2.0:1787833790.017989:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833790.021921:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381890432 00000100:00100000:2.0:1787833790.021936:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381890432 00000100:00100000:2.0:1787833790.022073:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1787833790.022084:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504487c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381890432:12345-192.168.203.17@tcp:400: 00000100:00100000:2.0:1787833790.022172:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504487c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381890432:12345-192.168.203.17@tcp:400: Request processed in 90us (4194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.022180:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00080000:3.0:1787833790.023111:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833790.032498:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381890048:12345-192.168.203.17@tcp:400: Request processed in 22806us (23951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833790.032514:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:1.0:1787833790.035517:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504484b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381890176:12345-192.168.203.17@tcp:400: Request processed in 23296us (26715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833790.035533:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00010000:00010000:3.0:1787833790.230059:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833790.294468:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833790.294498:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406062592:0@lo:13: 00000100:00100000:3.0:1787833790.294577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833790.295964:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406062592 00000100:00100000:1.0:1787833790.295976:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406062592 00000100:00100000:1.0:1787833790.296071:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787833790.296080:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406062592:12345-0@lo:13: 00002000:00000024:1.0:1787833790.296126:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833790.296211:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406062592:12345-0@lo:13: Request processed in 132us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833790.296236:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787833790.296293:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c1de00 x1874679406062592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833790.296313:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406062592:0@lo:13: 00000100:00080000:3.0:1787833790.296496:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833790.297155:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406062848:0@lo:400: 00000100:00100000:3.0:1787833790.297200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833790.297222:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406062976:0@lo:400: 00000100:00100000:3.0:1787833790.297233:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406063360:0@lo:400: 00000100:00100000:3.0:1787833790.297271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833790.297275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833790.297300:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406063872:0@lo:400: 00000100:00100000:0.0:1787833790.297306:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406063488:0@lo:400: 00000100:00100000:0.0:1787833790.297335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833790.297355:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406064000:0@lo:400: 00000100:00100000:3.0:1787833790.297362:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833790.297388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833790.297404:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406062848 00000100:00100000:3.0:1787833790.297410:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406062848 00000100:00100000:0.0:1787833790.297433:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406063360 00000100:00100000:0.0:1787833790.297439:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406063360 00000100:00100000:3.0:1787833790.297449:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787833790.297458:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3638:x1874679406062848:12345-0@lo:400: 00000100:00100000:3.0:1787833790.297502:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:3638:x1874679406062848:12345-0@lo:400: Request processed in 46us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833790.297509:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787833790.297548:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406062848:0@lo:400: 00000100:00100000:2.0:1787833790.297713:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406062976 00000100:00100000:2.0:1787833790.297717:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406062976 00000100:00100000:2.0:1787833790.297765:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406063488 00000100:00100000:2.0:1787833790.297768:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406063488 00000100:00100000:2.0:1787833790.297786:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406064000 00000100:00100000:2.0:1787833790.297788:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406064000 00000100:00100000:2.0:1787833790.297810:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787833790.297816:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406062976:12345-0@lo:400: 00000100:00100000:2.0:1787833790.297856:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406062976:12345-0@lo:400: Request processed in 40us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.297861:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787833790.297874:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787833790.297880:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406063488:12345-0@lo:400: 00000100:00100000:2.0:1787833790.297905:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406063488:12345-0@lo:400: Request processed in 26us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.297910:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787833790.297920:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787833790.297926:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406064000:12345-0@lo:400: 00000100:00100000:2.0:1787833790.297952:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406064000:12345-0@lo:400: Request processed in 26us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.297957:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787833790.297975:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406063104:0@lo:400: 00000100:00100000:2.0:1787833790.298002:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833790.298021:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406063616:0@lo:400: 00000100:00100000:2.0:1787833790.298041:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833790.298054:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406064128:0@lo:400: 00000100:00100000:2.0:1787833790.298071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833790.298084:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787833790.298091:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406062720:0@lo:13: 00000100:00100000:2.0:1787833790.298128:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833790.298143:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406063232:0@lo:400: 00000100:00100000:2.0:1787833790.298172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833790.298183:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406063744:0@lo:400: 00000100:00100000:2.0:1787833790.298201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833790.298216:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406064256:0@lo:400: 00000100:00100000:2.0:1787833790.298234:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833790.298262:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406063104 00000100:00100000:2.0:1787833790.298266:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406063104 00000100:00100000:2.0:1787833790.298287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787833790.298293:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406063360:12345-0@lo:400: 00000100:00100000:2.0:1787833790.298341:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406063360:12345-0@lo:400: Request processed in 48us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.298347:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787833790.298361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787833790.298366:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504486d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406063104:12345-0@lo:400: 00000100:00100000:2.0:1787833790.298398:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504486d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406063104:12345-0@lo:400: Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.298404:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787833790.298421:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406063616 00000100:00100000:2.0:1787833790.298424:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406063616 00000100:00100000:2.0:1787833790.298441:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406064128 00000100:00100000:2.0:1787833790.298444:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406064128 00000100:00100000:2.0:1787833790.298455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406063232 00000100:00100000:2.0:1787833790.298457:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406063232 00000100:00100000:2.0:1787833790.298468:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787833790.298475:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504486940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406063616:12345-0@lo:400: 00000100:00100000:2.0:1787833790.298506:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504486940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406063616:12345-0@lo:400: Request processed in 31us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.298522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787833790.298534:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787833790.298539:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504484780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406064128:12345-0@lo:400: 00000100:00100000:2.0:1787833790.298567:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504484780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406064128:12345-0@lo:400: Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.298574:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787833790.298585:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787833790.298590:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406063232:12345-0@lo:400: 00000100:00100000:2.0:1787833790.298618:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406063232:12345-0@lo:400: Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.298624:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787833790.298642:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406063872 00000100:00100000:2.0:1787833790.298645:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406063872 00000100:00100000:2.0:1787833790.298668:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406063744 00000100:00100000:2.0:1787833790.298670:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406063744 00000100:00100000:2.0:1787833790.298681:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406064256 00000100:00100000:2.0:1787833790.298683:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406064256 00000100:00100000:2.0:1787833790.298695:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787833790.298700:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406063872:12345-0@lo:400: 00000100:00100000:2.0:1787833790.298728:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406063872:12345-0@lo:400: Request processed in 28us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.298733:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787833790.298744:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787833790.298911:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406063744:12345-0@lo:400: 00000100:00100000:2.0:1787833790.298946:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406063744:12345-0@lo:400: Request processed in 196us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.298962:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787833790.298974:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787833790.298981:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504487840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406064256:12345-0@lo:400: 00000100:00100000:2.0:1787833790.299013:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504487840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406064256:12345-0@lo:400: Request processed in 33us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.299019:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787833790.299064:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406063232:0@lo:400: 00010000:00080000:2.0:1787833790.299078:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f970c0 x1874679406063744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833790.299089:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406063744:0@lo:400: 00010000:00080000:2.0:1787833790.299111:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f961c0 x1874679406064256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833790.299120:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406064256:0@lo:400: 00000100:00100000:2.0:1787833790.299130:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406063104:0@lo:400: 00010000:00080000:2.0:1787833790.299138:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f95e00 x1874679406063616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833790.299145:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406063616:0@lo:400: 00010000:00080000:2.0:1787833790.299153:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f97c00 x1874679406064128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833790.299160:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406064128:0@lo:400: 00000100:00100000:2.0:1787833790.299244:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406062976:0@lo:400: 00000100:00100000:2.0:1787833790.299256:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406063488:0@lo:400: 00000100:00100000:2.0:1787833790.299278:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406064000:0@lo:400: 00000100:00100000:1.0:1787833790.300706:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406062720 00000100:00100000:1.0:1787833790.300719:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406062720 00000100:00100000:1.0:1787833790.300798:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787833790.300809:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406062720:12345-0@lo:13: 00002000:00000024:1.0:1787833790.300838:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833790.300917:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406062720:12345-0@lo:13: Request processed in 111us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833790.300924:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787833790.300972:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0e1c0 x1874679406062720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833790.300992:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406062720:0@lo:13: 00000100:00080000:3.0:1787833790.301132:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833790.301138:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833790.301140:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787833790.301144:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833790.301169:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406063360:0@lo:400: 00010000:00080000:3.0:1787833790.301182:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f97840 x1874679406063872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833790.301191:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406063872:0@lo:400: 00000100:00100000:2.0:1787833790.966539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833790.966635:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381890560 00000100:00100000:3.0:1787833790.966644:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381890560 00000100:00100000:3.0:1787833790.966704:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 205 00000100:00100000:3.0:1787833790.966714:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:6175:x1874679381890560:12345-192.168.203.17@tcp:101: 00010000:00010000:3.0:1787833790.966729:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833790.966788:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ea73 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833790.966819:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea73 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833790.966843:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea73 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833790.966852:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246a00, rc 0) 00000100:00100000:3.0:1787833790.966917:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6175:x1874679381890560:12345-192.168.203.17@tcp:101: Request processed in 205us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833790.966924:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 205 00000100:00100000:3.0:1787833790.975228:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833790.975337:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381890688 00000100:00100000:2.0:1787833790.975347:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381890688 00000100:00100000:2.0:1787833790.975399:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 206 00000100:00100000:2.0:1787833790.975409:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6175:x1874679381890688:12345-192.168.203.17@tcp:501: 00000100:00100000:2.0:1787833790.975572:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6175:x1874679381890688:12345-192.168.203.17@tcp:501: Request processed in 164us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.975579:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 206 00000100:00100000:0.0:1787833790.981418:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833790.981513:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381890816 00000100:00100000:2.0:1787833790.981522:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381890816 00000100:00100000:2.0:1787833790.981573:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 207 00000100:00100000:2.0:1787833790.981581:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6175:x1874679381890816:12345-192.168.203.17@tcp:503: 00000100:00100000:2.0:1787833790.981733:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6175:x1874679381890816:12345-192.168.203.17@tcp:503: Request processed in 152us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833790.981741:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 207 00000100:00100000:0.0:1787833790.988888:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833790.989135:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381890944 00000100:00100000:3.0:1787833790.989145:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381890944 00000100:00100000:3.0:1787833790.989214:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 208 00000100:00100000:3.0:1787833790.989225:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6653:x1874679381890944:12345-192.168.203.17@tcp:502: 00000100:00100000:3.0:1787833790.989407:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6653:x1874679381890944:12345-192.168.203.17@tcp:502: Request processed in 183us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833790.989415:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 208 00000100:00100000:3.0:1787833790.996076:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833790.996145:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381891072 00000100:00100000:0.0:1787833790.996155:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381891072 00000100:00100000:0.0:1787833790.996207:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:0.0:1787833790.996216:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6653:x1874679381891072:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787833790.996379:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6653:x1874679381891072:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 163us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833790.996386:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:0.0:1787833791.016704:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833791.017101:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381891200 00000100:00100000:2.0:1787833791.017111:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381891200 00000100:00100000:2.0:1787833791.017258:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:2.0:1787833791.017278:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6175:x1874679381891200:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833791.017297:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833791.017315:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d31e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ea7a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.017344:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea7a expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.017376:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea7a expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.017386:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f800, rc 0) 00000100:00100000:2.0:1787833791.017453:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6175:x1874679381891200:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 186us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833791.017460:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:2.0:1787833791.037510:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833791.037588:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381891328 00000100:00100000:3.0:1787833791.037597:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381891328 00000100:00100000:3.0:1787833791.037651:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 211 00000100:00100000:3.0:1787833791.037660:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6175:x1874679381891328:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.037780:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6175:x1874679381891328:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 120us (277us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787833791.037788:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 211 00010000:00010000:1.0:1787833791.257577:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833791.322923:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833791.322966:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406064384:0@lo:41: 00000100:00100000:3.0:1787833791.323084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.323179:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406064384 00000100:00100000:3.0:1787833791.323188:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406064384 00000100:00100000:3.0:1787833791.323251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787833791.323261:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406064384:12345-0@lo:41: 00000004:00000024:3.0:1787833791.323302:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787833791.323365:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406064384:12345-0@lo:41: Request processed in 105us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833791.323372:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787833791.323429:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406064384:0@lo:41: 10000000:01000000:2.0:1787833791.382666:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787833791.382674:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df63fb44000 from 48 10000000:01000000:2.0:1787833791.382679:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833791.382727:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.382738:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.382763:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833791.382788:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406064512:0@lo:101: 00000100:00100000:2.0:1787833791.382861:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.382915:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504460840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.382984:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406064512 00000100:00100000:1.0:1787833791.382992:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406064512 00000100:00100000:1.0:1787833791.383045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787833791.383054:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+15:6511:x1874679406064512:12345-0@lo:101: 00010000:00010000:1.0:1787833791.383066:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833791.383078:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d32c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d325 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.383111:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d325 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.383141:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d325 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.383150:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a800, rc 0) 00000100:00100000:1.0:1787833791.383202:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406064512:12345-0@lo:101: Request processed in 149us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.383209:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787833791.383320:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406064512:0@lo:101: 00010000:00010000:2.0:1787833791.383335:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.383343:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833791.383421:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406064640:0@lo:501: 00000100:00100000:2.0:1787833791.383449:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.383473:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504460840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.383587:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406064640 00000100:00100000:1.0:1787833791.383592:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406064640 00000100:00100000:1.0:1787833791.383625:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787833791.383632:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406064640:12345-0@lo:501: 00000100:00100000:1.0:1787833791.383782:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406064640:12345-0@lo:501: Request processed in 118us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.383789:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787833791.383863:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406064640:0@lo:501: 00000100:00100000:3.0:1787833791.383893:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406064768:0@lo:503: 00000100:00100000:3.0:1787833791.383935:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.383966:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.384006:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406064768 00000100:00100000:1.0:1787833791.384011:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406064768 00000100:00100000:1.0:1787833791.384044:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787833791.384051:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406064768:12345-0@lo:503: 00000100:00100000:1.0:1787833791.384138:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406064768:12345-0@lo:503: Request processed in 87us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.384144:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787833791.384184:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406064768:0@lo:503: 00000100:00100000:1.0:1787833791.384375:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10353:1874679406064896:0@lo:502: 00000100:00100000:1.0:1787833791.384425:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.384445:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406064896 00000100:00100000:1.0:1787833791.384455:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406064896 00000100:00100000:1.0:1787833791.384475:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787833791.384481:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:10353:x1874679406064896:12345-0@lo:502: 00000100:00100000:1.0:1787833791.384559:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:10353:x1874679406064896:12345-0@lo:502: Request processed in 78us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.384566:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787833791.384594:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.384605:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10353:1874679406064896:0@lo:502: 00000100:00100000:1.0:1787833791.384643:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10353:1874679406065024:0@lo:502: 00000100:00100000:1.0:1787833791.384677:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.384695:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406065024 00000100:00100000:1.0:1787833791.384698:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406065024 00000100:00100000:1.0:1787833791.384716:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787833791.384722:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:10353:x1874679406065024:12345-0@lo:502: 00000100:00100000:1.0:1787833791.384811:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:10353:x1874679406065024:12345-0@lo:502: Request processed in 90us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.384818:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787833791.384846:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.384856:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10353:1874679406065024:0@lo:502: 00000040:00080000:1.0:1787833791.384875:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787833791.384925:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787833791.384944:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787833791.384953:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.384962:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833791.384981:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787833791.384983:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787833791.384986:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787833791.385008:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.385015:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.385024:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833791.385035:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065152:0@lo:101: 00000100:00100000:1.0:1787833791.385060:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.385076:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.385098:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406065152 00000100:00100000:1.0:1787833791.385101:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406065152 00000100:00100000:1.0:1787833791.385119:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787833791.385125:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+16:6511:x1874679406065152:12345-0@lo:101: 00010000:00010000:1.0:1787833791.385134:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833791.385144:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b200/0x996d2fb20dc1d33a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d333 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.385162:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b200/0x996d2fb20dc1d33a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d333 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.385171:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b200/0x996d2fb20dc1d33a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d333 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.385188:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b200, rc 0) 00000100:00100000:1.0:1787833791.385217:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406065152:12345-0@lo:101: Request processed in 91us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.385223:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787833791.385252:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065152:0@lo:101: 00010000:00010000:1.0:1787833791.385262:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.385271:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833791.385310:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065280:0@lo:501: 00000100:00100000:1.0:1787833791.385332:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.385344:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.385355:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406065280 00000100:00100000:1.0:1787833791.385357:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406065280 00000100:00100000:1.0:1787833791.385372:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787833791.385376:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406065280:12345-0@lo:501: 00000100:00100000:1.0:1787833791.385463:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406065280:12345-0@lo:501: Request processed in 85us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.385469:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787833791.385495:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065280:0@lo:501: 00000100:00100000:1.0:1787833791.385517:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065408:0@lo:503: 00000100:00100000:1.0:1787833791.385549:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.385562:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.385578:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406065408 00000100:00100000:1.0:1787833791.385582:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406065408 00000100:00100000:1.0:1787833791.385598:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787833791.385603:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406065408:12345-0@lo:503: 00000100:00100000:1.0:1787833791.385666:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406065408:12345-0@lo:503: Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.385672:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787833791.385706:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065408:0@lo:503: 00000100:00100000:2.0:1787833791.392134:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10354:1874679406065536:0@lo:502: 00000100:00100000:2.0:1787833791.392372:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.392554:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5044603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.399172:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406065536 00000100:00100000:1.0:1787833791.399185:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406065536 00000100:00100000:1.0:1787833791.399265:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787833791.399276:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:10354:x1874679406065536:12345-0@lo:502: 00000100:00100000:1.0:1787833791.399639:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:10354:x1874679406065536:12345-0@lo:502: Request processed in 365us (7267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.399647:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787833791.399738:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10354:1874679406065536:0@lo:502: 00000020:01000000:2.0:1787833791.399802:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833791.399811:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833791.399813:0:10354:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787833791.399818:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787833791.399846:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10354:1874679406065664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.399888:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.399912:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406065664 00000100:00100000:2.0:1787833791.399915:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406065664 00000100:00100000:2.0:1787833791.399936:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787833791.399942:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:10354:x1874679406065664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.400006:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:10354:x1874679406065664:12345-0@lo:502:llog_process_th.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833791.400012:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787833791.400048:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5044603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833791.400059:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10354:1874679406065664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787833791.400076:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833791.400080:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833791.400082:0:10354:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787833791.400102:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1787833791.400219:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787833791.400242:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787833791.400252:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.400263:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833791.400274:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787833791.400276:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df6359b9000 from 48 10000000:01000000:0.0:1787833791.400280:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787833791.400304:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.400312:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.400321:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833791.400345:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833791.400373:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833791.400401:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072840 going to sleep for 11 seconds 00000100:00100000:0.0:1787833791.400422:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406065792 00000100:00100000:0.0:1787833791.400425:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406065792 00000100:00100000:0.0:1787833791.400460:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787833791.400467:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+17:6511:x1874679406065792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833791.400475:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833791.400486:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6a00/0x996d2fb20dc1d348 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d341 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.400506:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6a00/0x996d2fb20dc1d348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d341 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.400516:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6a00/0x996d2fb20dc1d348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d341 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.400525:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6a00, rc 0) 00000100:00100000:0.0:1787833791.400562:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406065792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833791.400568:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787833791.401458:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833791.401478:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.401486:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833791.401550:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.401592:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.401626:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833791.401973:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406065920 00000100:00100000:0.0:1787833791.401981:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406065920 00000100:00100000:0.0:1787833791.402020:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787833791.402029:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406065920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833791.402176:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406065920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833791.402192:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787833791.405530:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406065920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.405607:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406066048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.405686:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.405727:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.405747:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406066048 00000100:00100000:1.0:1787833791.405778:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406066048 00000100:00100000:1.0:1787833791.405823:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787833791.405831:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406066048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.405940:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406066048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.405948:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787833791.406007:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406066048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.406185:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10356:1874679406066176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.406221:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.406239:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406066176 00000100:00100000:1.0:1787833791.406242:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406066176 00000100:00100000:1.0:1787833791.406277:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787833791.406284:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:10356:x1874679406066176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.406351:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:10356:x1874679406066176:12345-0@lo:502:llog_process_th.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.406357:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787833791.406552:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99480 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.406566:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10356:1874679406066176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.406608:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10356:1874679406066304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.406643:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.406672:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99480 going to sleep for 11 seconds 00000100:00100000:2.0:1787833791.406952:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406066304 00000100:00100000:2.0:1787833791.406958:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406066304 00000100:00100000:2.0:1787833791.406990:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787833791.406997:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:10356:x1874679406066304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.407084:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:10356:x1874679406066304:12345-0@lo:502:llog_process_th.0 Request processed in 87us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833791.407103:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787833791.407208:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10356:1874679406066304:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787833791.407232:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787833791.409009:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787833791.409044:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787833791.409056:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.409068:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833791.409077:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787833791.409081:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787833791.409084:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787833791.409126:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.409134:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.409144:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833791.409168:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406066432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787833791.409243:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.409289:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504460900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.411545:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406066432 00000100:00100000:1.0:1787833791.411558:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406066432 00000100:00100000:1.0:1787833791.411617:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787833791.411627:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+18:6511:x1874679406066432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833791.411642:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833791.411659:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1d356 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d34f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.411685:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1d356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d34f expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.411696:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1d356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d34f expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.411705:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ba00, rc 0) 00000100:00100000:1.0:1787833791.411798:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406066432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.411805:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787833791.412283:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406066432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833791.412304:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.412314:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833791.412394:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406066560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.412432:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.412470:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.412472:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406066560 00000100:00100000:1.0:1787833791.412477:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406066560 00000100:00100000:1.0:1787833791.412511:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787833791.412518:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406066560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.412639:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406066560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.412646:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787833791.413285:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406066560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.413329:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406066688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.413369:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.413402:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.414721:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406066688 00000100:00100000:1.0:1787833791.414732:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406066688 00000100:00100000:1.0:1787833791.414840:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787833791.414849:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406066688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.414991:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406066688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.414999:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787833791.415030:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406066688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.420682:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10357:1874679406066816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833791.420780:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.420823:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.421511:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406066816 00000100:00100000:1.0:1787833791.421521:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406066816 00000100:00100000:1.0:1787833791.421576:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787833791.421585:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:10357:x1874679406066816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.421719:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:10357:x1874679406066816:12345-0@lo:502:llog_process_th.0 Request processed in 135us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.421726:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787833791.425001:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10357:1874679406066816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833791.425058:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833791.425069:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833791.425071:0:10357:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787833791.425076:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787833791.425124:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10357:1874679406066944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833791.425207:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.425249:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787833791.425999:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406066944 00000100:00100000:2.0:1787833791.426007:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406066944 00000100:00100000:2.0:1787833791.426056:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787833791.426065:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:10357:x1874679406066944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.426222:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:10357:x1874679406066944:12345-0@lo:502:llog_process_th.0 Request processed in 157us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833791.426230:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787833791.426291:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10357:1874679406066944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833791.426322:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833791.426327:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833791.426329:0:10357:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787833791.426333:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1787833791.426459:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787833791.426479:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787833791.426491:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.426501:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833791.426510:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787833791.426513:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df63b1db800 from 48 10000000:01000000:0.0:1787833791.426515:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787833791.426542:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.426549:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.426557:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833791.426573:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833791.426605:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833791.426639:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833791.426741:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406067072 00000100:00100000:3.0:1787833791.426746:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406067072 00000100:00100000:3.0:1787833791.426802:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787833791.426809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:6511:x1874679406067072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833791.426817:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833791.426837:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247000/0x996d2fb20dc1d364 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d35d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.426868:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247000/0x996d2fb20dc1d364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d35d expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.426879:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247000/0x996d2fb20dc1d364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d35d expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.426888:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247000, rc 0) 00000100:00100000:3.0:1787833791.426923:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406067072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833791.426930:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787833791.427074:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833791.427095:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.427116:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833791.427171:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833791.427338:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833791.427369:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072600 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.433549:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406067200 00000100:00100000:1.0:1787833791.433563:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406067200 00000100:00100000:1.0:1787833791.433640:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787833791.433650:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406067200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.433885:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406067200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (6686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.433893:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787833791.434066:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.434137:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.442362:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.442484:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.447274:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406067328 00000100:00100000:1.0:1787833791.447288:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406067328 00000100:00100000:1.0:1787833791.447427:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787833791.447437:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406067328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.447597:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406067328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (5242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.447609:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787833791.447696:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833791.448248:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10359:1874679406067456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.448297:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.448332:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.448403:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406067456 00000100:00100000:1.0:1787833791.448409:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406067456 00000100:00100000:1.0:1787833791.448444:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787833791.448452:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:10359:x1874679406067456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.448538:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:10359:x1874679406067456:12345-0@lo:502:llog_process_th.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.448545:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787833791.448641:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10359:1874679406067456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.448682:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10359:1874679406067584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.448714:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.448734:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387180 going to sleep for 11 seconds 00000100:00100000:3.0:1787833791.448810:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406067584 00000100:00100000:3.0:1787833791.448814:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406067584 00000100:00100000:3.0:1787833791.448836:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787833791.448841:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:10359:x1874679406067584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833791.448905:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:10359:x1874679406067584:12345-0@lo:502:llog_process_th.0 Request processed in 63us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833791.448912:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787833791.449018:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10359:1874679406067584:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787833791.449036:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787833791.449171:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787833791.449194:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787833791.449217:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.449227:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833791.449235:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787833791.449238:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1787833791.449240:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787833791.449264:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.449272:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.449282:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833791.449294:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.449319:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.449345:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.449425:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406067712 00000100:00100000:1.0:1787833791.449429:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406067712 00000100:00100000:1.0:1787833791.449463:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787833791.449471:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406067712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833791.449479:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833791.449491:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1d372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d36b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.449510:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1d372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d36b expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.449520:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1d372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d36b expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.449528:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ae00, rc 0) 00000100:00100000:1.0:1787833791.449572:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406067712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.449577:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787833791.449638:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833791.449649:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.449658:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833791.449714:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833791.449738:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.449778:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.449825:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406067840 00000100:00100000:1.0:1787833791.449834:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406067840 00000100:00100000:1.0:1787833791.449862:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787833791.449868:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406067840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.449960:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406067840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.449966:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787833791.450117:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833791.450144:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833791.450179:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.450217:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.450315:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406067968 00000100:00100000:1.0:1787833791.450319:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406067968 00000100:00100000:1.0:1787833791.450348:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787833791.450355:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406067968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.450434:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406067968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.450441:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787833791.450518:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406067968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833791.450822:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10360:1874679406068096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.450854:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.450869:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.450989:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406068096 00000100:00100000:1.0:1787833791.450993:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406068096 00000100:00100000:1.0:1787833791.451024:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787833791.451031:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:10360:x1874679406068096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.451181:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:10360:x1874679406068096:12345-0@lo:502:llog_process_th.0 Request processed in 150us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.451189:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787833791.452703:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10360:1874679406068096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833791.452876:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833791.452908:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833791.452910:0:10360:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787833791.452917:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787833791.452962:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10360:1874679406068224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833791.453029:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.453109:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833791.455714:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406068224 00000100:00100000:2.0:1787833791.455731:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406068224 00000100:00100000:1.0:1787833791.461562:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787833791.461576:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:10360:x1874679406068224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.461816:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:10360:x1874679406068224:12345-0@lo:502:llog_process_th.0 Request processed in 243us (8786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.461825:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787833791.467411:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10360:1874679406068224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833791.467461:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833791.467469:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833791.467471:0:10360:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787833791.467476:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1787833791.470872:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1787833791.470910:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787833791.470924:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.470936:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833791.470949:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787833791.470952:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df60efc3000 from 48 10000000:01000000:3.0:1787833791.470954:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787833791.470995:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.471003:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.471014:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833791.471038:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406068352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.471126:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.471171:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a240 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.471845:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406068352 00000100:00100000:1.0:1787833791.471865:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406068352 00000100:00100000:1.0:1787833791.471920:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787833791.471929:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406068352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833791.471953:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833791.471968:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d379 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.471994:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d379 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.472005:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d379 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833791.472014:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b800, rc 0) 00000100:00100000:1.0:1787833791.472073:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406068352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.472080:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787833791.472150:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406068352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833791.472166:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.472175:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833791.472251:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406068480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833791.472281:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833791.472310:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.472437:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406068480 00000100:00100000:1.0:1787833791.472442:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406068480 00000100:00100000:1.0:1787833791.472472:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787833791.472478:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406068480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.472596:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406068480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.472603:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787833791.475597:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406068480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.475672:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406068608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.475778:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.475826:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833791.475859:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406068608 00000100:00100000:2.0:1787833791.475865:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406068608 00000100:00100000:2.0:1787833791.475917:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787833791.475927:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406068608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833791.476050:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406068608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833791.476057:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787833791.476407:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406068608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.476977:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10361:1874679406068736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833791.477022:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.477061:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787833791.478594:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406068736 00000100:00100000:2.0:1787833791.478609:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406068736 00000100:00100000:2.0:1787833791.478674:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787833791.478684:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:10361:x1874679406068736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.478868:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:10361:x1874679406068736:12345-0@lo:502:llog_process_th.0 Request processed in 184us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833791.478877:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787833791.479096:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10361:1874679406068736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.479160:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10361:1874679406068864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.479215:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833791.479258:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833791.479350:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406068864 00000100:00100000:2.0:1787833791.479355:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406068864 00000100:00100000:2.0:1787833791.479389:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787833791.479397:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:10361:x1874679406068864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.479478:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:10361:x1874679406068864:12345-0@lo:502:llog_process_th.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833791.479486:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787833791.479882:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10361:1874679406068864:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787833791.479910:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787833791.480210:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787833791.480241:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787833791.480252:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.480277:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833791.480287:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787833791.480290:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1787833791.480293:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787833791.480325:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.480333:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.480343:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833791.480361:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406068992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833791.480418:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833791.480453:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833791.480665:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406068992 00000100:00100000:3.0:1787833791.480671:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406068992 00000100:00100000:3.0:1787833791.480714:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787833791.480722:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406068992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833791.480734:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833791.480746:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247a00/0x996d2fb20dc1d38e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d387 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.480815:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247a00/0x996d2fb20dc1d38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d387 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.480827:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247a00/0x996d2fb20dc1d38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d387 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.480836:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247a00, rc 0) 00000100:00100000:3.0:1787833791.480892:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406068992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833791.480898:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787833791.481519:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406068992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833791.481539:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833791.481548:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833791.481619:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406069120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833791.481655:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833791.481704:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.481794:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406069120 00000100:00100000:1.0:1787833791.481799:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406069120 00000100:00100000:1.0:1787833791.481835:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787833791.481842:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406069120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833791.481968:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406069120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.481975:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787833791.482486:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406069120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833791.482519:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406069248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833791.482562:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833791.482585:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833791.483558:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406069248 00000100:00100000:3.0:1787833791.483568:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406069248 00000100:00100000:3.0:1787833791.483628:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787833791.483637:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406069248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.483803:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406069248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833791.483811:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787833791.484286:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406069248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.486801:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f95a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10362:1874679406069376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833791.487701:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.487777:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833791.488036:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406069376 00000100:00100000:1.0:1787833791.488045:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406069376 00000100:00100000:1.0:1787833791.488106:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787833791.488116:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:10362:x1874679406069376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833791.488277:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:10362:x1874679406069376:12345-0@lo:502:llog_process_th.0 Request processed in 162us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833791.488285:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787833791.490343:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f95a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10362:1874679406069376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833791.490408:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833791.490420:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833791.490422:0:10362:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787833791.490428:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787833791.490470:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10362:1874679406069504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833791.490542:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833791.490588:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833791.491040:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406069504 00000100:00100000:2.0:1787833791.491048:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406069504 00000100:00100000:2.0:1787833791.491107:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787833791.491116:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:10362:x1874679406069504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833791.491244:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:10362:x1874679406069504:12345-0@lo:502:llog_process_th.0 Request processed in 129us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833791.491252:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787833791.491559:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10362:1874679406069504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833791.491587:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833791.491592:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833791.491594:0:10362:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787833791.491598:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787833791.491811:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1787833791.491832:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787833791.491843:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.491855:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833791.491865:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787833791.491867:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df60ec73490 from 1 10000000:01000000:2.0:1787833791.491878:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787833791.491904:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.491911:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833791.491920:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833791.491950:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406069632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787833791.491996:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833791.492024:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833791.495464:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406069632 00000100:00100000:3.0:1787833791.495481:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406069632 00000100:00100000:3.0:1787833791.495575:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787833791.495587:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406069632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833791.495607:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833791.495638:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b246e00/0x996d2fb20dc1d39c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d395 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.495670:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b246e00/0x996d2fb20dc1d39c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d395 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.495682:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b246e00/0x996d2fb20dc1d39c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d395 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.495692:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246e00, rc 0) 00000100:00100000:3.0:1787833791.495787:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406069632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (3791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833791.495794:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787833791.495972:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406069632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833791.495990:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d39c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.496018:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d39c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833791.496118:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406069760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.496150:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833791.496168:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787833791.496182:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406069760 00000100:00100000:3.0:1787833791.496186:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406069760 00000100:00100000:3.0:1787833791.496218:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787833791.496225:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406069760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833791.496293:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406069760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (142us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787833791.496300:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787833791.496328:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406069760:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787833791.496352:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787833791.496359:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d39c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833791.496366:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d39c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787833792.063603:0:10392:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcbb4aa020 20000000:00000080:0.0:1787833792.063622:0:10392:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df503c1a400 uarg=0000000000000000 20000000:01000000:0.0:1787833792.063665:0:10392:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787833792.063671:0:10392:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787833792.063676:0:10392:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787833792.066570:0:10393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787833792.066747:0:10392:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787833792.072494:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787833792.072535:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787833792.072550:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787833792.072566:0:10392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787833792.072584:0:10392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.072605:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d03f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d038 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.072612:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d046 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.072618:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d09a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.072624:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d1c0 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.072651:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea3b expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.072659:0:10392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.072696:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea3b expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.072711:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea3b expref: 9 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833792.072724:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406069888:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833792.073680:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d1c0 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.073694:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1c0 expref: 23 pid: 6507 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833792.073705:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406070016:0@lo:104: 00000100:00100000:2.0:1787833792.073745:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833792.073907:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d09a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.073915:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d09a expref: 23 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833792.073923:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406070144:0@lo:104: 00000100:00100000:2.0:1787833792.073972:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787833792.075997:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d046 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.076017:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d046 expref: 23 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833792.076061:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406070272:0@lo:104: 00010000:00010000:3.0:1787833792.076126:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d038 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.076134:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d03f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d038 expref: 23 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833792.076141:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406070400:0@lo:104: 00000100:00100000:3.0:1787833792.076160:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833792.077140:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787833792.077181:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833792.077344:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833792.077410:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406070016 00000100:00100000:1.0:1787833792.077415:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406070144 00000100:00100000:2.0:1787833792.077419:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406070016 00000100:00100000:1.0:1787833792.077419:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406070144 00000100:00100000:2.0:1787833792.077460:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406070400 00000100:00100000:1.0:1787833792.077460:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406070272 00000100:00100000:2.0:1787833792.077463:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406070400 00000100:00100000:1.0:1787833792.077463:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406070272 00000100:00100000:2.0:1787833792.077477:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833792.077488:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:10392:x1874679406070016:12345-0@lo:104: 00010000:00010000:2.0:1787833792.077505:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.077579:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833792.077584:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:10392:x1874679406070016:12345-0@lo:104: Request processed in 102us (3840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833792.077665:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406070016:0@lo:104: 00000100:00100000:3.0:1787833792.079644:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406069888:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833792.083350:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833792.083364:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.083376:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fd800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833792.083381:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.083391:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833792.083397:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833792.083403:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787833792.083454:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.083476:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833792.083500:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.083506:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6013fd800/0x996d2fb20dc1d1c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d1c7 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.083527:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833792.083528:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833792.083530:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833792.083557:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406070528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833792.083627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833792.085202:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787833792.085230:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:10392:x1874679406070144:12345-0@lo:104: 00010000:00010000:1.0:1787833792.085249:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085352:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833792.085358:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:10392:x1874679406070144:12345-0@lo:104: Request processed in 145us (11385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833792.085382:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787833792.085418:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787833792.085424:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:10392:x1874679406070400:12345-0@lo:104: 00010000:00010000:1.0:1787833792.085433:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085468:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787833792.085474:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:10392:x1874679406070400:12345-0@lo:104: Request processed in 50us (8129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833792.085479:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787833792.085494:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787833792.085499:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:10392:x1874679406070272:12345-0@lo:104: 00010000:00010000:1.0:1787833792.085507:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085539:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787833792.085543:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:10392:x1874679406070272:12345-0@lo:104: Request processed in 45us (8365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833792.085548:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787833792.085580:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406070528 00000100:00100000:1.0:1787833792.085588:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406070528 00010000:00010000:1.0:1787833792.085611:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1c0 expref: 24 pid: 6507 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833792.085633:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787833792.085639:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406070528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833792.085650:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833792.085663:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1c0 expref: 24 pid: 6507 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085674:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d1c0 expref: 24 pid: 6507 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085690:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d1c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d1c0 expref: 24 pid: 6507 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085705:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833792.085736:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3639:x1874679406070528:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833792.085741:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1787833792.085779:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787833792.085785:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085792:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833792.085796:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085806:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833792.085813:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833792.085819:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787833792.085850:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085867:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833792.085889:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085896:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d09a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d0a1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085906:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787833792.085909:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085914:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833792.085916:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085923:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833792.085929:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833792.085933:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787833792.085948:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085953:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833792.085959:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085965:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1d038 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d03f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085982:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833792.085985:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.085991:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6421c8a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833792.085994:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.086001:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833792.086007:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833792.086011:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787833792.086024:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833792.086437:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833792.086612:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833792.086642:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381891456 00000100:00100000:2.0:1787833792.086940:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381891456 00010000:00010000:2.0:1787833792.086971:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea3b expref: 10 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833792.087001:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:2.0:1787833792.087008:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2401:x1874679381891456:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833792.087020:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833792.087025:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea3b expref: 10 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.087048:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea3b expref: 10 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.087156:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1d2df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea3b expref: 10 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.087170:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833792.087226:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:2401:x1874679381891456:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 218us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833792.087313:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00010000:00010000:2.0:1787833792.087817:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833792.087854:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406070528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833792.087877:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833792.088479:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406070144:0@lo:104: 00000100:00100000:3.0:1787833792.088490:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406070272:0@lo:104: 00000100:00100000:3.0:1787833792.088498:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1874679406070400:0@lo:104: 00010000:00010000:3.0:1787833792.088527:0:10392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833792.088816:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406070656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787833792.088889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833792.091960:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833792.092008:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.092021:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6421c8a00/0x996d2fb20dc1d046 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d04d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.092051:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833792.092054:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833792.092057:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833792.092079:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406070784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833792.092177:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833792.095529:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406070656 00000100:00100000:2.0:1787833792.095544:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406070656 00010000:00010000:3.0:1787833792.095819:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d09a expref: 23 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833792.095856:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406070784 00000100:00100000:3.0:1787833792.095859:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406070784 00010000:00010000:3.0:1787833792.095872:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d03f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d038 expref: 24 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833792.095891:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787833792.095900:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406070656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833792.095930:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833792.095936:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d09a expref: 24 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.095948:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d09a expref: 24 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.095966:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031400/0x996d2fb20dc1d0a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d09a expref: 24 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.095982:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833792.096055:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3640:x1874679406070656:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (7165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833792.096062:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787833792.096080:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787833792.096098:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e164c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:3641:x1874679406070784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833792.096107:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833792.096111:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d03f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d038 expref: 22 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.096120:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d038 expref: 22 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.096130:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d03f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d038 expref: 22 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833792.096139:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833792.096163:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e164c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3641:x1874679406070784:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833792.096178:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787833792.096245:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406070912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833792.096282:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833792.096516:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406070656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833792.096688:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406070784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833792.096713:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406070912 00000100:00100000:1.0:1787833792.096717:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406070912 00010000:00010000:1.0:1787833792.096735:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d046 expref: 21 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833792.096779:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787833792.096786:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3638:x1874679406070912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833792.096795:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833792.096799:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d046 expref: 21 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096807:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d046 expref: 21 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096818:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600030600/0x996d2fb20dc1d04d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d046 expref: 21 pid: 6508 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096830:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096838:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096851:0:8457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096858:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096875:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096881:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096887:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fe00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787833792.096890:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096897:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096916:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833792.096926:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833792.096957:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3638:x1874679406070912:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833792.096963:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787833792.097114:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406070912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787833792.097164:0:10392:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833792.097172:0:10392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833792.097178:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1d3a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833792.279200:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833792.758939:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833792.759031:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381891584 00000100:00100000:0.0:1787833792.759040:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381891584 00000100:00100000:0.0:1787833792.759112:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 254 00000100:00100000:0.0:1787833792.759123:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:6175:x1874679381891584:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833792.759140:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833792.759164:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ea81 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833792.759194:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea81 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833792.759205:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea81 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833792.759214:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7000, rc 0) 00000100:00100000:0.0:1787833792.759269:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6175:x1874679381891584:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 149us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833792.759290:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 254 00000100:00100000:3.0:1787833792.770265:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833792.770346:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381891712 00000100:00100000:0.0:1787833792.770356:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381891712 00000100:00100000:0.0:1787833792.770416:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 255 00000100:00100000:0.0:1787833792.770427:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6175:x1874679381891712:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833792.770568:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6175:x1874679381891712:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 144us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833792.770575:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 255 00000100:00100000:0.0:1787833792.775300:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833792.775370:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381891840 00000100:00100000:3.0:1787833792.775380:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381891840 00000100:00100000:3.0:1787833792.775434:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 256 00000100:00100000:3.0:1787833792.775444:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6175:x1874679381891840:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833792.775588:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6175:x1874679381891840:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 145us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833792.775596:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 256 00000100:00100000:0.0:1787833792.786151:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833792.786234:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381891968 00000100:00100000:1.0:1787833792.786245:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381891968 00000100:00100000:1.0:1787833792.786315:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 257 00000100:00100000:1.0:1787833792.786327:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6706:x1874679381891968:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787833792.786505:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6706:x1874679381891968:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 180us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833792.786514:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 257 00000100:00100000:3.0:1787833792.799622:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833792.802223:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381892096 00000100:00100000:2.0:1787833792.802238:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381892096 00000100:00100000:2.0:1787833792.802307:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 258 00000100:00100000:2.0:1787833792.802318:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6706:x1874679381892096:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833792.802491:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:6706:x1874679381892096:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 173us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833792.802500:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 258 00000100:00100000:0.0:1787833792.854317:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833792.854340:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406071040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833792.854402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833792.854500:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406071040 00000100:00100000:0.0:1787833792.854507:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406071040 00000100:00100000:0.0:1787833792.854561:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787833792.854569:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406071040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833792.854599:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833792.854640:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406071040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833792.854646:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787833792.854667:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833792.854694:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504485e00 x1874679406071040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833792.854710:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406071040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833792.854857:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833792.854867:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406071168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833792.854896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833792.855086:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406071168 00000100:00100000:0.0:1787833792.855091:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406071168 00000100:00100000:0.0:1787833792.855129:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787833792.855136:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406071168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833792.855147:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833792.855176:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406071168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833792.855182:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787833792.855204:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504485e00 x1874679406071168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833792.855217:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406071168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787833792.855321:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1787833793.109883:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833793.109892:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63fb44000 from 4 10000000:01000000:3.0:1787833793.109899:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833793.109950:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.109962:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.109973:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833793.110000:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406071296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833793.110087:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833793.110149:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833793.110207:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406071296 00000100:00100000:2.0:1787833793.110217:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406071296 00000100:00100000:2.0:1787833793.110293:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787833793.110304:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406071296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833793.110318:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833793.110333:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d3b1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.110357:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3b1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.110368:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3b1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.110377:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4ee00, rc 0) 00000100:00100000:2.0:1787833793.110415:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406071296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833793.110422:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787833793.110634:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406071296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833793.110650:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.110657:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833793.110716:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406071424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833793.110741:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833793.110786:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833793.110869:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406071424 00000100:00100000:1.0:1787833793.110880:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406071424 00000100:00100000:1.0:1787833793.110913:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787833793.110921:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406071424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833793.111030:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406071424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833793.111037:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787833793.111139:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406071424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833793.111167:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406071552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833793.111206:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833793.111242:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833793.111331:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406071552 00000100:00100000:2.0:1787833793.111335:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406071552 00000100:00100000:2.0:1787833793.111364:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787833793.111371:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406071552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.111453:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406071552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833793.111460:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787833793.111640:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406071552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833793.112217:0:10415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10415:1874679406071680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833793.112272:0:10415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833793.112305:0:10415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833793.112409:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406071680 00000100:00100000:2.0:1787833793.112414:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406071680 00000100:00100000:2.0:1787833793.112451:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787833793.112458:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:10415:x1874679406071680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833793.112566:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:10415:x1874679406071680:12345-0@lo:502:llog_process_th.0 Request processed in 108us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833793.112579:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787833793.112720:0:10415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10415:1874679406071680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833793.112774:0:10415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833793.112784:0:10415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833793.112787:0:10415:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787833793.112793:0:10415:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df63fb44000 00000020:00000080:1.0:1787833793.112796:0:10415:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787833793.112864:0:10415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10415:1874679406071808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833793.112899:0:10415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833793.112921:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406071808 00000100:00100000:1.0:1787833793.112925:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406071808 00000100:00100000:1.0:1787833793.112943:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787833793.112949:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:10415:x1874679406071808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833793.113017:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:10415:x1874679406071808:12345-0@lo:502:llog_process_th.0 Request processed in 67us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833793.113023:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787833793.113051:0:10415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833793.113061:0:10415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10415:1874679406071808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833793.113091:0:10415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833793.113096:0:10415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833793.113097:0:10415:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787833793.113101:0:10415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787833793.113166:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787833793.113184:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833793.113194:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833793.113204:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833793.113214:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787833793.113217:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df6359b9000 from 4 10000000:01000000:1.0:1787833793.113219:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833793.113255:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833793.113263:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833793.113272:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833793.113284:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406071936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833793.113312:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833793.113326:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833793.113339:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406071936 00000100:00100000:1.0:1787833793.113342:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406071936 00000100:00100000:1.0:1787833793.113359:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787833793.113364:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406071936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833793.113372:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833793.113384:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d3bf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833793.113415:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3bf expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833793.113426:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3bf expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833793.113435:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b600, rc 0) 00000100:00100000:1.0:1787833793.113478:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406071936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833793.113484:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787833793.113515:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406071936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833793.113527:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833793.113535:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833793.113578:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833793.113602:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833793.113614:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833793.113625:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406072064 00000100:00100000:1.0:1787833793.113628:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406072064 00000100:00100000:1.0:1787833793.113644:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787833793.113650:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406072064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833793.113733:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406072064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833793.113772:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787833793.113802:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833793.113829:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833793.113864:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833793.113877:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833793.113887:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406072192 00000100:00100000:1.0:1787833793.113890:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406072192 00000100:00100000:1.0:1787833793.113906:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787833793.113911:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406072192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833793.113977:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406072192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833793.113984:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787833793.114021:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833793.125280:0:10416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10416:1874679406072320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833793.125364:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833793.125407:0:10416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833793.125836:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406072320 00000100:00100000:1.0:1787833793.125844:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406072320 00000100:00100000:0.0:1787833793.125982:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787833793.125993:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:10416:x1874679406072320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833793.126119:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:10416:x1874679406072320:12345-0@lo:502:llog_process_th.0 Request processed in 127us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833793.126126:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787833793.126182:0:10416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10416:1874679406072320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833793.126206:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833793.126215:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833793.126217:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787833793.126223:0:10416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df6359b9000 00000020:00000080:0.0:1787833793.126225:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787833793.126580:0:10416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10416:1874679406072448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833793.126618:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833793.126643:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406072448 00000100:00100000:0.0:1787833793.126643:0:10416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac240 going to sleep for 11 seconds 00000100:00100000:3.0:1787833793.126648:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406072448 00000100:00100000:3.0:1787833793.126684:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787833793.126691:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:10416:x1874679406072448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833793.126791:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:10416:x1874679406072448:12345-0@lo:502:llog_process_th.0 Request processed in 100us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833793.129565:0:10416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10416:1874679406072448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833793.129616:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833793.129628:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833793.129630:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787833793.129634:0:10416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787833793.130065:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787833793.130101:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787833793.130112:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.130124:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833793.130135:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787833793.130137:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63b1db800 from 4 10000000:01000000:2.0:1787833793.130140:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787833793.130177:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.130184:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.130194:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833793.130213:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.130388:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833793.130424:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5038476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833793.130440:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406072576 00000100:00100000:2.0:1787833793.130445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406072576 00000100:00100000:3.0:1787833793.130820:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787833793.131026:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787833793.131037:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406072576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833793.131051:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833793.131073:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d3cd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.131109:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3cd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.131120:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3cd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.131128:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e800, rc 0) 00000100:00100000:2.0:1787833793.131177:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406072576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833793.131183:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787833793.133901:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833793.133956:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.133967:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833793.134093:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.134160:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833793.134211:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5038476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833793.135397:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406072704 00000100:00100000:2.0:1787833793.135407:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406072704 00000100:00100000:2.0:1787833793.135466:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787833793.135475:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406072704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.136440:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406072704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 962us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833793.136571:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787833793.137044:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.137108:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.137164:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833793.137194:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5038476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833793.137221:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406072832 00000100:00100000:2.0:1787833793.139139:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406072832 00000100:00100000:2.0:1787833793.139207:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787833793.139216:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406072832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.139369:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406072832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833793.139377:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787833793.139446:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406072832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833793.143008:0:10420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10420:1874679406072960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833793.143097:0:10420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833793.143150:0:10420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833793.143356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406072960 00000100:00100000:2.0:1787833793.143363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406072960 00000100:00100000:2.0:1787833793.143411:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787833793.143420:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:10420:x1874679406072960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833793.143535:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:10420:x1874679406072960:12345-0@lo:502:llog_process_th.0 Request processed in 116us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833793.143543:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787833793.144093:0:10420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10420:1874679406072960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833793.144124:0:10420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833793.144133:0:10420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833793.144135:0:10420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787833793.144142:0:10420:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df63b1db800 00000020:00000080:1.0:1787833793.144144:0:10420:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787833793.144269:0:10420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10420:1874679406073088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833793.144319:0:10420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833793.144353:0:10420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833793.144416:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406073088 00000100:00100000:0.0:1787833793.144422:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406073088 00000100:00100000:0.0:1787833793.144463:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787833793.144471:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:10420:x1874679406073088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833793.144557:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:10420:x1874679406073088:12345-0@lo:502:llog_process_th.0 Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833793.144565:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787833793.149316:0:10420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10420:1874679406073088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833793.149363:0:10420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833793.149378:0:10420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833793.149380:0:10420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787833793.149385:0:10420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787833793.153212:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787833793.153261:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833793.153272:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.153284:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833793.153294:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833793.153297:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df60efc3000 from 4 10000000:01000000:3.0:1787833793.153300:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833793.153341:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.153348:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.153358:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833793.153384:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406073216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833793.153446:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833793.153485:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e73840 going to sleep for 11 seconds 00000100:00100000:3.0:1787833793.153915:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406073216 00000100:00100000:3.0:1787833793.154147:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406073216 00000100:00100000:3.0:1787833793.154194:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787833793.154202:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406073216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833793.154215:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833793.154292:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d3db expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.154318:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3db expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.154328:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3db expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.154337:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247e00, rc 0) 00000100:00100000:3.0:1787833793.154385:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406073216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833793.154392:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787833793.154437:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406073216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833793.154450:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.154616:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833793.154910:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406073344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833793.155110:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833793.155402:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406073344 00000100:00100000:0.0:1787833793.155409:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406073344 00000100:00100000:3.0:1787833793.170092:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e73840 going to sleep for 11 seconds 00000100:00100000:0.0:1787833793.176189:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787833793.176209:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406073344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833793.176361:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406073344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (21251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833793.176368:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787833793.177863:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406073344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.177920:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406073472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.177991:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833793.178033:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406073472 00000100:00100000:2.0:1787833793.178038:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503847f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787833793.178040:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406073472 00000100:00100000:2.0:1787833793.178101:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787833793.178110:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406073472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833793.178210:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406073472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833793.178217:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787833793.178264:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406073472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833793.183095:0:10423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10423:1874679406073600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833793.183175:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833793.183215:0:10423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833793.186412:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406073600 00000100:00100000:2.0:1787833793.186426:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406073600 00000100:00100000:2.0:1787833793.186484:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787833793.186493:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:10423:x1874679406073600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833793.186645:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:10423:x1874679406073600:12345-0@lo:502:llog_process_th.0 Request processed in 153us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833793.186653:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787833793.187236:0:10423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10423:1874679406073600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833793.187271:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833793.187282:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833793.187284:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787833793.187292:0:10423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df60efc3000 00000020:00000080:1.0:1787833793.187294:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787833793.187380:0:10423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10423:1874679406073728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833793.187434:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833793.187468:0:10423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833793.188143:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406073728 00000100:00100000:3.0:1787833793.188151:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406073728 00000100:00100000:3.0:1787833793.188201:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787833793.188211:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:10423:x1874679406073728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833793.188347:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:10423:x1874679406073728:12345-0@lo:502:llog_process_th.0 Request processed in 137us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833793.188356:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787833793.190024:0:10423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:10423:1874679406073728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833793.190063:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833793.190071:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833793.190073:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787833793.190088:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787833793.190285:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787833793.190311:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833793.190322:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833793.190333:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833793.304114:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833794.330148:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833794.902202:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833794.902271:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406073856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787833794.902349:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833794.908575:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406073856 00000100:00100000:0.0:1787833794.908589:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406073856 00000100:00100000:0.0:1787833794.908665:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787833794.908676:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406073856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787833794.908713:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787833794.908870:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406073856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 196us (6520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833794.908878:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787833794.910471:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406073856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833795.129895:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833795.129947:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833795.129975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833795.130027:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833795.130052:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833795.130088:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381892608 00000100:00100000:1.0:1787833795.130098:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381892608 00000100:00100000:1.0:1787833795.130150:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381892736 00000100:00100000:1.0:1787833795.130153:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381892736 00000100:00100000:0.0:1787833795.130283:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381892352 00000100:00100000:0.0:1787833795.130287:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381892352 00000100:00100000:0.0:1787833795.130315:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381892480 00000100:00100000:0.0:1787833795.130318:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381892480 00000100:00100000:0.0:1787833795.130342:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:0.0:1787833795.130352:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381892352:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833795.130423:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381892352:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 73us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833795.130430:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:0.0:1787833795.130447:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:0.0:1787833795.130453:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381892480:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833795.130479:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381892480:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833795.130485:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:0.0:1787833795.130609:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787833795.130617:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381892608:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833795.130647:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381892608:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 32us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833795.130653:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787833795.130666:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:0.0:1787833795.130672:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381892736:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833795.130695:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381892736:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833795.130724:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00080000:2.0:1787833795.131389:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833795.131396:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833795.131397:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381892224 00000100:00080000:2.0:1787833795.131399:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833795.131404:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833795.131406:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381892224 00000100:00100000:3.0:1787833795.131454:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 279 00000100:00100000:3.0:1787833795.131462:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2401:x1874679381892224:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833795.131511:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2401:x1874679381892224:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 49us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833795.131517:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 279 00010000:00010000:2.0:1787833795.350055:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833795.414253:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406073984:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.414345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.414395:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406074496:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.414422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.414441:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406075008:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.414461:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.414476:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406075520:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.414494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.415440:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787833795.415455:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406074112:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.415510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.415540:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406074624:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.415557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.415576:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406075136:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.415593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.415671:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406074496 00000100:00100000:1.0:1787833795.415678:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406074496 00000100:00100000:1.0:1787833795.415726:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787833795.415733:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406074496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.415796:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406074496:12345-0@lo:400:kworker.0 Request processed in 62us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833795.415816:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787833795.415843:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406074112 00000100:00100000:1.0:1787833795.415847:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406074112 00000100:00100000:1.0:1787833795.415866:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406074624 00000100:00100000:1.0:1787833795.415868:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406074624 00000100:00100000:1.0:1787833795.415884:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406075136 00000100:00100000:1.0:1787833795.415886:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406075136 00000100:00100000:1.0:1787833795.415897:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787833795.415903:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406074112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.415932:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406074112:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833795.415938:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787833795.415949:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787833795.415953:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406074624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.415973:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406074624:12345-0@lo:400:kworker.0 Request processed in 20us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833795.415977:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787833795.415985:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787833795.415990:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406075136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.416008:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406075136:12345-0@lo:400:kworker.0 Request processed in 19us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833795.416013:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787833795.416029:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406074368:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.416051:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.416081:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406074880:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.416100:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.416123:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406075392:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.416143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.416160:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787833795.416166:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406074240:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.416187:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.416204:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406074752:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.416224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.416235:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406075264:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.416253:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.416274:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406074240 00000100:00100000:1.0:1787833795.416277:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406074240 00000100:00100000:1.0:1787833795.416300:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787833795.416306:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406074240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418167:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406075648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833795.418251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833795.418315:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406075648 00000100:00100000:2.0:1787833795.418324:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406075648 00000100:00100000:2.0:1787833795.418373:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787833795.418381:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504486580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406075648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833795.418409:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833795.418449:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504486580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406075648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.418456:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787833795.418479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406074368 00000100:00100000:2.0:1787833795.418482:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406074368 00000100:00100000:2.0:1787833795.418496:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406074752 00000100:00100000:2.0:1787833795.418499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406074752 00000100:00100000:2.0:1787833795.418510:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406075264 00000100:00100000:2.0:1787833795.418512:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406075264 00000100:00100000:2.0:1787833795.418523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787833795.418528:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406074368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406074368:12345-0@lo:400:kworker.0 Request processed in 52us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.418587:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787833795.418599:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787833795.418605:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406074752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418633:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406074752:12345-0@lo:400:kworker.0 Request processed in 29us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.418638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787833795.418648:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787833795.418654:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406075264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418683:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406075264:12345-0@lo:400:kworker.0 Request processed in 30us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.418688:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787833795.418702:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833795.418706:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833795.418707:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787833795.418731:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c1cb40 x1874679406075648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833795.418747:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406075648:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787833795.418828:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb86580 x1874679406074752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833795.418837:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406074752:0@lo:400:kworker.0 00010000:00080000:2.0:1787833795.418847:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb86940 x1874679406075264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833795.418856:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406075264:0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418865:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406074368:0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418900:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406074112:0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418909:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406074624:0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418919:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406075136:0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418930:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406074496:0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.418958:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406073984 00000100:00100000:2.0:1787833795.418961:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406073984 00000100:00100000:2.0:1787833795.418995:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787833795.419000:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406073984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.419031:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406073984:12345-0@lo:400:kworker.0 Request processed in 30us (4686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.419036:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787833795.419075:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406073984:0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.419126:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406075008 00000100:00100000:2.0:1787833795.419129:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406075008 00000100:00100000:2.0:1787833795.419153:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406075520 00000100:00100000:2.0:1787833795.419156:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406075520 00000100:00100000:2.0:1787833795.419165:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406074880 00000100:00100000:2.0:1787833795.419167:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406074880 00000100:00100000:2.0:1787833795.419177:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406075392 00000100:00100000:2.0:1787833795.419179:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406075392 00000100:00100000:2.0:1787833795.419193:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833795.419199:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406075008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.419233:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406075008:12345-0@lo:400:kworker.0 Request processed in 34us (4771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.419239:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833795.419250:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787833795.419256:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406075520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.419282:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406075520:12345-0@lo:400:kworker.0 Request processed in 26us (4786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.419287:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787833795.419297:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787833795.419302:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406074880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.419326:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406074880:12345-0@lo:400:kworker.0 Request processed in 25us (3225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.419337:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787833795.419346:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787833795.419351:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406075392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833795.419374:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406075392:12345-0@lo:400:kworker.0 Request processed in 24us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.419379:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787833795.419415:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833795.419418:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833795.419431:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406075776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833795.419455:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833795.419478:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406075776 00000100:00100000:2.0:1787833795.419481:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406075776 00000100:00100000:2.0:1787833795.419496:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833795.419501:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504485e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406075776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787833795.419511:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833795.419534:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504485e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406075776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833795.419540:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787833795.419563:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb85680 x1874679406074880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833795.419572:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406074880:0@lo:400:kworker.0 00010000:00080000:2.0:1787833795.419581:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb84780 x1874679406075392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833795.419588:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406075392:0@lo:400:kworker.0 00010000:00080000:2.0:1787833795.419622:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5044861c0 x1874679406075776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833795.419632:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406075776:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787833795.419653:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb87c00 x1874679406075008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833795.419662:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406075008:0@lo:400:kworker.0 00010000:00080000:2.0:1787833795.419670:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb870c0 x1874679406075520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833795.419677:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406075520:0@lo:400:kworker.0 00000100:00100000:1.0:1787833795.422687:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406074240:12345-0@lo:400:kworker.0 Request processed in 6372us (6491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833795.422703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787833795.422742:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406074240:0@lo:400:kworker.0 00010000:00010000:2.0:1787833796.375104:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833796.439396:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406075904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787833796.439476:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833796.439560:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406075904 00000100:00100000:3.0:1787833796.439569:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406075904 00000100:00100000:3.0:1787833796.439614:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787833796.439623:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406075904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787833796.439655:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787833796.439782:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406075904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833796.439789:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787833796.439837:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406075904:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787833797.399644:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833797.974981:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833797.975011:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406076032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833797.975104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833797.975182:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406076032 00000100:00100000:1.0:1787833797.975189:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406076032 00000100:00100000:1.0:1787833797.975248:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787833797.975258:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406076032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833797.975287:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833797.975333:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406076032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833797.975352:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787833797.975373:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787833797.975405:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0c3c0 x1874679406076032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833797.975424:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406076032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833797.975683:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833797.975695:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406076160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833797.975728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833797.979960:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406076160 00000100:00100000:3.0:1787833797.979975:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406076160 00000100:00100000:3.0:1787833797.980144:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787833797.980155:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406076160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787833797.980185:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833797.980284:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406076160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (4554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833797.980292:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787833797.980347:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f94b40 x1874679406076160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833797.980367:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406076160:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787833797.980776:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787833798.424499:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787833799.350363:0:10692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787833799.448981:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833800.022063:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833800.022087:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406076288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833800.022161:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.022307:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406076288 00000100:00100000:2.0:1787833800.022315:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406076288 00000100:00100000:2.0:1787833800.022412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787833800.022422:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406076288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833800.022457:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833800.022514:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406076288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833800.022522:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787833800.022589:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406076288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833800.248577:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833800.248625:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833800.248663:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833800.248680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833800.248705:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833800.248734:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381892992 00000100:00100000:1.0:1787833800.248742:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381892992 00000100:00100000:1.0:1787833800.248825:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381893120 00000100:00100000:1.0:1787833800.248829:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381893120 00000100:00100000:1.0:1787833800.248853:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:1.0:1787833800.248875:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381892992:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833800.248947:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381892992:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 74us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833800.248955:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:1.0:1787833800.248970:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:1.0:1787833800.249003:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381893120:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833800.249043:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381893120:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 42us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833800.249050:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:1.0:1787833800.249070:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381893248 00000100:00100000:1.0:1787833800.249074:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381893248 00000100:00100000:1.0:1787833800.249109:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381893376 00000100:00100000:1.0:1787833800.249112:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381893376 00000100:00100000:1.0:1787833800.249133:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:1.0:1787833800.249139:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381893248:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833800.249324:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381893248:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833800.249333:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:1.0:1787833800.249347:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:1.0:1787833800.249353:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381893376:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833800.249379:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381893376:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833800.249385:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00080000:1.0:1787833800.249401:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833800.249405:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833800.249407:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833800.249409:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833800.249593:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381892864 00000100:00100000:0.0:1787833800.249599:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381892864 00000100:00100000:0.0:1787833800.249637:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 281 00000100:00100000:0.0:1787833800.249645:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2399:x1874679381892864:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833800.249685:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2399:x1874679381892864:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 41us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833800.249692:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 281 00010000:00010000:0.0:1787833800.469859:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833800.536389:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406076800:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.536493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.536552:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406077312:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.536579:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.536599:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406077824:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.536632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.536665:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787833800.536671:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406076416:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.536700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.536721:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406076928:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.536744:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.536779:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406077440:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.536802:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.536815:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406077952:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.536855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.536896:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406076416 00000100:00100000:2.0:1787833800.536903:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406076416 00000100:00100000:2.0:1787833800.536958:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787833800.536967:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406076416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537034:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406076544:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.537044:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406076416:12345-0@lo:400:kworker.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833800.537052:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787833800.537072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.537089:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406077312 00000100:00100000:2.0:1787833800.537094:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406077312 00000100:00100000:3.0:1787833800.537099:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406077056:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.537125:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406077824 00000100:00100000:3.0:1787833800.537128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.537130:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406077824 00000100:00100000:3.0:1787833800.537150:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406077568:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.537150:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406077440 00000100:00100000:2.0:1787833800.537155:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406077440 00000100:00100000:2.0:1787833800.537171:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406077952 00000100:00100000:2.0:1787833800.537174:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406077952 00000100:00100000:2.0:1787833800.537192:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787833800.537196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.537203:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406077312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537218:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406078080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833800.537259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.537263:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406077312:12345-0@lo:400:kworker.0 Request processed in 62us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833800.537274:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787833800.537289:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787833800.537297:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406077824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537299:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787833800.537309:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406076672:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.537330:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406077824:12345-0@lo:400:kworker.0 Request processed in 33us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833800.537337:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833800.537343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.537351:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787833800.537358:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406077440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537371:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406077184:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.537391:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406077440:12345-0@lo:400:kworker.0 Request processed in 33us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833800.537398:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833800.537404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.537412:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787833800.537421:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406077952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537423:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406077696:0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.537462:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406077952:12345-0@lo:400:kworker.0 Request processed in 41us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833800.537470:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787833800.537489:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406076928 00000100:00100000:3.0:1787833800.537494:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406076928 00000100:00100000:2.0:1787833800.537512:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406076416:0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537528:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406076672 00010000:00080000:2.0:1787833800.537530:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f41e00 x1874679406077440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833800.537533:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406076672 00000100:00100000:2.0:1787833800.537545:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406077440:0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537556:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1787833800.537561:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ff3c00 x1874679406077952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833800.537568:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406076928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.537588:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406077952:0@lo:400:kworker.0 00010000:00080000:2.0:1787833800.537604:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec43c0 x1874679406077312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833800.537613:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406076928:12345-0@lo:400:kworker.0 Request processed in 49us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833800.537614:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406077312:0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537628:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1787833800.537632:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ff0000 x1874679406077824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833800.537641:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406077824:0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537648:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787833800.537656:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406076672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.537680:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406076928:0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.537699:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406076672:12345-0@lo:400:kworker.0 Request processed in 43us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833800.537707:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787833800.537794:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406076800 00000100:00100000:3.0:1787833800.537798:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406076800 00000100:00100000:3.0:1787833800.537817:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406076544 00000100:00100000:3.0:1787833800.537820:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406076544 00000100:00100000:3.0:1787833800.537830:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406077056 00000100:00100000:3.0:1787833800.537833:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406077056 00000100:00100000:3.0:1787833800.537845:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406077568 00000100:00100000:3.0:1787833800.537853:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406077568 00000100:00100000:3.0:1787833800.537879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406077184 00000100:00100000:3.0:1787833800.537882:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406077184 00000100:00100000:0.0:1787833800.538299:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406077696 00000100:00100000:0.0:1787833800.538306:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406077696 00000100:00100000:0.0:1787833800.538331:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787833800.538338:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406076800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833800.538386:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406076800:12345-0@lo:400:kworker.0 Request processed in 48us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833800.538392:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787833800.538404:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787833800.538410:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406076544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833800.538436:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406076544:12345-0@lo:400:kworker.0 Request processed in 27us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833800.538452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787833800.538463:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787833800.538469:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406077056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833800.538500:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406077056:12345-0@lo:400:kworker.0 Request processed in 31us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833800.538505:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787833800.538517:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787833800.538525:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406077568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833800.538553:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406077568:12345-0@lo:400:kworker.0 Request processed in 29us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833800.538559:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787833800.538570:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787833800.538576:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406077696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833800.538600:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406077696:12345-0@lo:400:kworker.0 Request processed in 25us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833800.538606:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787833800.538826:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406078080 00000100:00100000:2.0:1787833800.538831:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406078080 00000100:00100000:2.0:1787833800.538858:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787833800.538865:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406078080:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833800.539064:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406078208:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833800.539072:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833800.539103:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406078080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 239us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833800.539109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833800.539110:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787833800.539121:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406078208 00000100:00100000:2.0:1787833800.539123:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406078208 00000100:00100000:2.0:1787833800.539137:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787833800.539142:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406078208:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787833800.539149:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:2.0:1787833800.539150:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787833800.539153:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833800.539162:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833800.539164:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833800.539313:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787833800.539326:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406077184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.539363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406077184:12345-0@lo:400:kworker.0 Request processed in 41us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833800.539369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787833800.539433:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406076672:0@lo:400:kworker.0 00010000:00080000:3.0:1787833800.539448:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a8cf00 x1874679406077184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833800.539457:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406077184:0@lo:400:kworker.0 00010000:00080000:3.0:1787833800.539467:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ff2d00 x1874679406077696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833800.539475:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406077696:0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.539488:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406076544:0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.539498:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406077056:0@lo:400:kworker.0 00000100:00100000:3.0:1787833800.539508:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406077568:0@lo:400:kworker.0 00010000:00080000:3.0:1787833800.539518:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f96940 x1874679406078080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833800.539531:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406078080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833800.539777:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406076800:0@lo:400:kworker.0 00000100:00100000:2.0:1787833800.539846:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406078208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 702us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833800.539864:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787833800.543206:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0e1c0 x1874679406078208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833800.543239:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406078208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787833801.495108:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833801.558955:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833801.558989:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406078336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833801.559433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833801.561574:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406078336 00000100:00100000:2.0:1787833801.561590:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406078336 00000100:00100000:2.0:1787833801.561675:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787833801.561686:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406078336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787833801.561730:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787833801.561857:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406078336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 173us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833801.561871:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787833801.562523:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406078336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787833802.517897:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833803.093976:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406078464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787833803.094067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833803.094135:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406078464 00000100:00100000:3.0:1787833803.094142:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406078464 00000100:00100000:3.0:1787833803.094190:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787833803.094199:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406078464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787833803.094225:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833803.094263:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406078464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833803.094270:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787833803.094289:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833803.094313:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f96940 x1874679406078464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833803.094331:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406078464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833803.095728:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833803.095744:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406078592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833803.095807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833803.095852:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406078592 00000100:00100000:2.0:1787833803.095858:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406078592 00000100:00100000:2.0:1787833803.095899:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787833803.095907:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406078592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833803.095937:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833803.095974:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406078592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833803.095981:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787833803.096027:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef7840 x1874679406078592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833803.096042:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406078592:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787833803.096062:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787833803.543919:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787833803.871607:0:10936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing yml_node 00010000:00010000:3.0:1787833804.566030:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833805.142146:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406078720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833805.142219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833805.142397:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406078720 00000100:00100000:3.0:1787833805.142406:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406078720 00000100:00100000:3.0:1787833805.142466:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787833805.142476:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406078720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787833805.142508:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833805.143380:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406078720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 900us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833805.143389:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787833805.143899:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406078720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833805.378058:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833805.378108:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833805.378138:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833805.378235:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833805.378427:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381893504 00000100:00100000:2.0:1787833805.378448:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381893504 00000100:00100000:2.0:1787833805.378496:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 283 00000100:00100000:2.0:1787833805.378506:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2399:x1874679381893504:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833805.378576:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2399:x1874679381893504:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 72us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833805.378583:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 283 00000100:00100000:2.0:1787833805.378619:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381893888 00000100:00100000:2.0:1787833805.378622:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381893888 00000100:00100000:2.0:1787833805.378658:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1787833805.378664:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2397:x1874679381893888:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:2.0:1787833805.378689:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d2f4 00000100:00080000:2.0:1787833805.378698:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8df5038aa800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787833805.378738:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787833805.378912:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+2:2397:x1874679381893888:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 247us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833805.378920:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00080000:2.0:1787833805.378941:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833805.379617:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833805.382890:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381894016 00000100:00100000:2.0:1787833805.382906:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381894016 00000100:00100000:2.0:1787833805.382977:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:2.0:1787833805.383000:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c5cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2397:x1874679381894016:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:2.0:1787833805.383038:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d2fb 00000100:00080000:2.0:1787833805.383049:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8df5039c0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787833805.383091:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1787833805.383469:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787833805.383511:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833805.383580:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c5cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+2:2397:x1874679381894016:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 591us (5313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833805.383589:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00010000:00010000:2.0:1787833805.383852:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833805.384633:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381893760 00000100:00100000:0.0:1787833805.384642:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381893760 00000100:00100000:0.0:1787833805.384707:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381893632 00000100:00100000:0.0:1787833805.384711:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381893632 00000100:00100000:0.0:1787833805.384738:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:0.0:1787833805.384747:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381893760:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833805.384828:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381893760:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 83us (6720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833805.384835:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:0.0:1787833805.384851:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:0.0:1787833805.384858:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381893632:12345-192.168.203.17@tcp:400:kworker.0 00000100:00080000:1.0:1787833805.384979:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833805.384985:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833805.385345:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381893632:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 486us (7204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833805.385353:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 94 00010000:00010000:3.0:1787833805.594037:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833805.654034:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406078848:0@lo:400:kworker.0 00000100:00100000:0.0:1787833805.654088:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406079104:0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.654113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833805.654211:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406079232:0@lo:400:kworker.0 00000100:00100000:2.0:1787833805.654245:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406078848 00000100:00100000:2.0:1787833805.654252:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406078848 00000100:00100000:2.0:1787833805.654307:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787833805.654317:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406078848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833805.658891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833805.658965:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406079616:0@lo:400:kworker.0 00000100:00100000:0.0:1787833805.659014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833805.659040:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406080128:0@lo:400:kworker.0 00000100:00100000:0.0:1787833805.659062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833805.659131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406079104 00000100:00100000:0.0:1787833805.659138:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406079104 00000100:00100000:0.0:1787833805.659185:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787833805.659193:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406079104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.660741:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406079360:0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.660812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833805.660842:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406079872:0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.660865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833805.660885:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406080384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833805.660908:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833805.660929:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787833805.660936:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406078976:0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.660957:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833805.660974:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406079488:0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.661006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833805.661021:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406080000:0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.661039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833805.661108:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406079360 00000100:00100000:3.0:1787833805.661114:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406079360 00000100:00100000:3.0:1787833805.661156:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406079872 00000100:00100000:3.0:1787833805.661159:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406079872 00000100:00100000:3.0:1787833805.661172:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406078976 00000100:00100000:3.0:1787833805.661174:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406078976 00000100:00100000:3.0:1787833805.661184:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406079488 00000100:00100000:3.0:1787833805.661186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406079488 00000100:00100000:3.0:1787833805.661197:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406080000 00000100:00100000:3.0:1787833805.661199:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406080000 00000100:00100000:3.0:1787833805.661215:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787833805.661223:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406079360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.661269:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406079360:12345-0@lo:400:kworker.0 Request processed in 46us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833805.661291:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787833805.661310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787833805.661317:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406079872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.661349:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406079872:12345-0@lo:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833805.661355:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787833805.661367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787833805.661373:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406078976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.661421:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406078976:12345-0@lo:400:kworker.0 Request processed in 49us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833805.661427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787833805.661459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833805.661473:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406078848:12345-0@lo:400:kworker.0 Request processed in 7155us (7358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833805.661484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787833805.661492:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406079744:0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.661508:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406079232 00000100:00100000:3.0:1787833805.661513:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406079232 00000100:00100000:1.0:1787833805.661530:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833805.661532:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406080384 00000100:00100000:3.0:1787833805.661538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787833805.661538:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406080384 00000100:00100000:3.0:1787833805.661551:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406079488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.661555:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406080256:0@lo:400:kworker.0 00000100:00100000:2.0:1787833805.661591:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787833805.661593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833805.661599:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406079488:12345-0@lo:400:kworker.0 Request processed in 50us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833805.661606:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406080384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833805.661611:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787833805.661631:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00002000:00000024:2.0:1787833805.661635:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833805.661639:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406079616 00000100:00100000:3.0:1787833805.661641:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406080000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.661645:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406079616 00000100:00100000:1.0:1787833805.661677:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406080128 00000100:00100000:2.0:1787833805.661683:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406080384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833805.661683:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406080128 00000100:00100000:3.0:1787833805.661690:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406080000:12345-0@lo:400:kworker.0 Request processed in 50us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833805.661698:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787833805.661701:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406079744 00000100:00100000:3.0:1787833805.661702:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787833805.661706:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406079744 00000100:00100000:3.0:1787833805.661725:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787833805.661731:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406080256 00000100:00100000:3.0:1787833805.661736:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406079232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.661736:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406080256 00000100:00100000:2.0:1787833805.661737:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833805.661766:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406079616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.661791:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787833805.661799:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406080128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.661811:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406079232:12345-0@lo:400:kworker.0 Request processed in 78us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833805.661819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787833805.661839:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406079616:12345-0@lo:400:kworker.0 Request processed in 92us (2822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833805.661848:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406080512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833805.661849:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833805.661870:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787833805.661878:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406079744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.662337:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406080128:12345-0@lo:400:kworker.0 Request processed in 537us (3271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833805.662345:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787833805.662358:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787833805.662365:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406080256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.662415:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406080256:12345-0@lo:400:kworker.0 Request processed in 51us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833805.662421:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787833805.662444:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833805.662447:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833805.662450:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833805.662452:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833805.662575:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406079232:0@lo:400:kworker.0 00010000:00080000:1.0:1787833805.662593:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb852c0 x1874679406080256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833805.662604:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406080256:0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.662704:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406078976:0@lo:400:kworker.0 00010000:00080000:1.0:1787833805.662716:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb870c0 x1874679406079488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833805.662726:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406079488:0@lo:400:kworker.0 00010000:00080000:1.0:1787833805.662737:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb85a40 x1874679406080000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833805.662786:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406080000:0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.662801:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406079360:0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.662812:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406079872:0@lo:400:kworker.0 00010000:00080000:1.0:1787833805.662822:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5046db480 x1874679406080384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833805.662835:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406080384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833805.662844:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406078848:0@lo:400:kworker.0 00010000:00080000:1.0:1787833805.662897:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb87c00 x1874679406079616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833805.662906:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406079616:0@lo:400:kworker.0 00010000:00080000:1.0:1787833805.662916:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb86d00 x1874679406080128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833805.662923:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406080128:0@lo:400:kworker.0 00000100:00100000:3.0:1787833805.664792:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833805.664842:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406079744:12345-0@lo:400:kworker.0 Request processed in 2961us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833805.664862:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787833805.664863:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406080512 00000100:00100000:3.0:1787833805.664872:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406080512 00000100:00100000:3.0:1787833805.664919:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787833805.664928:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406080512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787833805.664949:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833805.665055:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406080512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833805.665062:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787833805.665389:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6f840 x1874679406080512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833805.665408:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406080512:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787833805.665455:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb84780 x1874679406079744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833805.665473:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406079744:0@lo:400:kworker.0 00000100:00100000:1.0:1787833805.668530:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406079104:0@lo:400:kworker.0 00000100:00100000:0.0:1787833805.668602:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406079104:12345-0@lo:400:kworker.0 Request processed in 9407us (9716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833805.668613:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:1.0:1787833806.614776:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833806.678966:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406080640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833806.679050:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833806.679385:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406080640 00000100:00100000:3.0:1787833806.679394:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406080640 00000100:00100000:3.0:1787833806.679454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787833806.679465:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406080640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787833806.679500:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787833806.679564:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406080640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833806.679571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787833806.680281:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406080640:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787833807.638657:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833808.221067:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406080768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833808.221143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833808.221730:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406080768 00000100:00100000:3.0:1787833808.221740:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406080768 00000100:00100000:3.0:1787833808.222028:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787833808.222040:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406080768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833808.222072:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833808.222146:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406080768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833808.222153:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787833808.222177:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833808.222210:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5046da1c0 x1874679406080768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833808.222228:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406080768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833808.224459:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833808.224480:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406080896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833808.224539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833808.225060:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406080896 00000100:00100000:1.0:1787833808.225068:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406080896 00000100:00100000:1.0:1787833808.225126:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787833808.225134:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406080896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833808.225156:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833808.225209:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406080896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833808.225215:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787833808.225251:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5046d8f00 x1874679406080896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833808.226457:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406080896:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787833808.228102:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1787833808.630190:0:11120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.98 00010000:00010000:1.0:1787833808.666922:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833809.686645:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833810.262541:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833810.262566:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406081024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833810.262643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833810.263089:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406081024 00000100:00100000:2.0:1787833810.263098:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406081024 00000100:00100000:2.0:1787833810.263155:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787833810.263164:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406081024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833810.263195:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833810.263416:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406081024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 252us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833810.263425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787833810.263505:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406081024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833810.486968:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833810.487010:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833810.487041:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833810.487131:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381894144 00000100:00100000:2.0:1787833810.487141:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381894144 00000100:00100000:2.0:1787833810.487196:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 285 00000100:00100000:2.0:1787833810.487205:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2398:x1874679381894144:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833810.487283:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2398:x1874679381894144:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 78us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833810.487291:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 285 00000100:00100000:0.0:1787833810.487425:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381894400 00000100:00100000:0.0:1787833810.487429:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381894400 00000100:00100000:0.0:1787833810.487470:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381894272 00000100:00100000:0.0:1787833810.487473:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381894272 00000100:00100000:0.0:1787833810.487502:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:0.0:1787833810.487510:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381894400:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833810.487541:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381894400:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 32us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833810.487548:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:0.0:1787833810.487561:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:0.0:1787833810.487567:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2398:x1874679381894272:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833810.487589:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2398:x1874679381894272:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 22us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833810.487596:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00080000:2.0:1787833810.487808:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787833810.487812:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787833810.711428:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833810.774072:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406081408:0@lo:400:kworker.0 00000100:00100000:0.0:1787833810.774142:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833810.774143:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406081280:0@lo:400:kworker.0 00000100:00100000:1.0:1787833810.774252:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406081152:0@lo:400:kworker.0 00000100:00100000:2.0:1787833810.774363:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406081536:0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.774417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833810.774467:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406081792:0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.774973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833810.775009:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406082304:0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.775034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833810.775106:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406081280 00000100:00100000:3.0:1787833810.775112:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406081280 00000100:00100000:3.0:1787833810.775147:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406081792 00000100:00100000:3.0:1787833810.775149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406081792 00000100:00100000:3.0:1787833810.775170:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406082304 00000100:00100000:3.0:1787833810.775172:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406082304 00000100:00100000:3.0:1787833810.775185:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787833810.775192:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406081280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.775241:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406081280:12345-0@lo:400:kworker.0 Request processed in 49us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833810.775249:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787833810.775264:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787833810.775270:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406081792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.775311:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406081792:12345-0@lo:400:kworker.0 Request processed in 41us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833810.775317:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787833810.775328:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787833810.775334:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406082304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.775434:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406082304:12345-0@lo:400:kworker.0 Request processed in 99us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833810.775440:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787833810.775672:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406081280:0@lo:400:kworker.0 00010000:00080000:3.0:1787833810.775689:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb843c0 x1874679406081792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833810.775699:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406081792:0@lo:400:kworker.0 00010000:00080000:3.0:1787833810.775709:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb852c0 x1874679406082304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833810.775716:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406082304:0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.775733:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833810.775739:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406082688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833810.775789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833810.775827:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406082688 00000100:00100000:3.0:1787833810.775831:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406082688 00000100:00100000:3.0:1787833810.775866:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787833810.775873:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406082688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787833810.775896:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833810.775931:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406082688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833810.775945:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787833810.775989:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b392c0 x1874679406082688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833810.776003:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406082688:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787833810.776034:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833810.776038:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787833810.776080:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406081408 00000100:00100000:3.0:1787833810.776084:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406081408 00000100:00100000:3.0:1787833810.776110:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787833810.776115:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406081408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.776150:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406081408:12345-0@lo:400:kworker.0 Request processed in 35us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833810.776156:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787833810.776175:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406082816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833810.776199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833810.776221:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406082816 00000100:00100000:3.0:1787833810.776225:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406082816 00000100:00100000:3.0:1787833810.776247:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787833810.776253:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406082816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833810.776263:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833810.777669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833810.777719:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406081664:0@lo:400:kworker.0 00000100:00100000:1.0:1787833810.777772:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833810.777794:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406082176:0@lo:400:kworker.0 00000100:00100000:1.0:1787833810.777818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833810.777862:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406081152 00000100:00100000:1.0:1787833810.777869:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406081152 00000100:00100000:1.0:1787833810.777920:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787833810.777929:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406081152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833810.778028:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406081152:12345-0@lo:400:kworker.0 Request processed in 100us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833810.778035:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787833810.778065:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406081664 00000100:00100000:1.0:1787833810.778069:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406081664 00000100:00100000:1.0:1787833810.778091:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406082176 00000100:00100000:1.0:1787833810.778094:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406082176 00000100:00100000:1.0:1787833810.778108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787833810.778115:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406081664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833810.778405:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406081664:12345-0@lo:400:kworker.0 Request processed in 289us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833810.778413:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787833810.778428:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787833810.778437:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406082176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.778944:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406082816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2688us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833810.778963:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787833810.778992:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833810.778996:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787833810.779025:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b392c0 x1874679406082816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833810.779058:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406082816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833810.779139:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406081408:0@lo:400:kworker.0 00000100:00100000:0.0:1787833810.780140:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406081920:0@lo:400:kworker.0 00000100:00100000:0.0:1787833810.780393:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833810.780425:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406082432:0@lo:400:kworker.0 00000100:00100000:0.0:1787833810.780447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833810.780503:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406081920 00000100:00100000:0.0:1787833810.780510:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406081920 00000100:00100000:0.0:1787833810.780572:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406082432 00000100:00100000:0.0:1787833810.780575:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406082432 00000100:00100000:0.0:1787833810.780604:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787833810.780612:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406081920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.780617:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787833810.780630:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406082432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.780679:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406082432:12345-0@lo:400:kworker.0 Request processed in 53us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833810.780829:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406081920:12345-0@lo:400:kworker.0 Request processed in 216us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833810.780879:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787833810.780921:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833810.780972:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833810.780975:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406081152:0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.780995:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406081664:0@lo:400:kworker.0 00000100:00100000:2.0:1787833810.781008:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406081536 00000100:00100000:2.0:1787833810.781013:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406081536 00000100:00100000:3.0:1787833810.781039:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406082048:0@lo:400:kworker.0 00000100:00100000:2.0:1787833810.781045:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787833810.781054:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406081536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.781076:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833810.781102:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406081536:12345-0@lo:400:kworker.0 Request processed in 49us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833810.781105:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406082048 00000100:00100000:3.0:1787833810.781110:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406082048 00000100:00100000:2.0:1787833810.781111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787833810.781160:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406082560:0@lo:400:kworker.0 00000100:00100000:2.0:1787833810.781185:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833810.781202:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406082560 00000100:00100000:2.0:1787833810.781205:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406082560 00000100:00100000:1.0:1787833810.783309:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406082176:12345-0@lo:400:kworker.0 Request processed in 4864us (5480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833810.783324:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787833810.783393:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406082176:0@lo:400:kworker.0 00010000:00080000:1.0:1787833810.783452:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb85a40 x1874679406081920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833810.783465:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406081920:0@lo:400:kworker.0 00010000:00080000:1.0:1787833810.783478:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb87840 x1874679406082432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833810.783508:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406082432:0@lo:400:kworker.0 00000100:00100000:0.0:1787833810.786019:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787833810.786129:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406081536:0@lo:400:kworker.0 00000100:00080000:0.0:1787833810.786166:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833810.789882:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787833810.789908:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406082048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833810.790015:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406082048:12345-0@lo:400:kworker.0 Request processed in 122us (8939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833810.790023:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787833810.791523:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb870c0 x1874679406082048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833810.791550:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406082048:0@lo:400:kworker.0 00000100:00100000:2.0:1787833810.794201:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787833810.794235:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406082560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833810.794419:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406082560:12345-0@lo:400:kworker.0 Request processed in 207us (13231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833810.794428:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787833810.794544:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0fc00 x1874679406082560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833810.794560:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406082560:0@lo:400:kworker.0 00000001:00100000:0.0:1787833811.303252:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:0.0:1787833811.303334:0:8424:0:(genops.c:885:class_export_put()) final put ffff8df5038a9800/a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:1.0:1787833811.303617:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5038a9800/a4724ace-a769-4adb-acca-a2bfbc389c92 for lustre-OST0000 00000020:00000080:1.0:1787833811.303672:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5038aa800 for lustre-OST0000 00000001:00100000:1.0:1787833811.307610:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:1.0:1787833811.307620:0:9510:0:(genops.c:885:class_export_put()) final put ffff8df5039c6000/a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:0.0:1787833811.307675:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039c6000/a4724ace-a769-4adb-acca-a2bfbc389c92 for lustre-OST0001 00000020:00000080:0.0:1787833811.317508:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5039c0800 for lustre-OST0001 00010000:00010000:1.0:1787833811.739328:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833811.804933:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406082944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833811.805018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833811.814884:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406082944 00000100:00100000:3.0:1787833811.814899:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406082944 00000100:00100000:3.0:1787833811.814965:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787833811.814975:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406082944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787833811.815013:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787833811.815096:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406082944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (10077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833811.815116:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787833811.815160:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406082944:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1787833811.818610:0:11217:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.98 00010000:00010000:1.0:1787833812.763122:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833813.334007:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833813.334045:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406083072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833813.334113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833813.334335:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406083072 00000100:00100000:3.0:1787833813.334344:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406083072 00000100:00100000:3.0:1787833813.334472:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787833813.334482:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406083072:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833813.334776:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406083200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833813.334810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833813.334951:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787833813.334960:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787833813.335221:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833813.335274:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406083072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 793us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833813.335281:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787833813.335298:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406083200 00000100:00100000:3.0:1787833813.335302:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406083200 00010000:00080000:1.0:1787833813.335415:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5046d8f00 x1874679406083072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833813.335445:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406083072:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787833813.340413:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833813.340722:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787833813.340736:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406083200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833813.340788:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833813.340873:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406083200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (6062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833813.340880:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787833813.340998:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5046da1c0 x1874679406083200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833813.341020:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406083200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787833813.798112:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787833814.653014:0:11315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.98 00010000:00010000:3.0:1787833814.812995:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833815.382129:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833815.382155:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406083328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833815.382237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833815.382363:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406083328 00000100:00100000:2.0:1787833815.382370:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406083328 00000100:00100000:2.0:1787833815.382411:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787833815.382418:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406083328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833815.382448:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833815.382504:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406083328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833815.382511:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787833815.382590:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406083328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833815.608601:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833815.608645:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833815.608680:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833815.608784:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381894528 00000100:00100000:1.0:1787833815.608794:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381894528 00000100:00100000:1.0:1787833815.608853:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 287 00000100:00100000:1.0:1787833815.608863:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2399:x1874679381894528:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833815.608948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2399:x1874679381894528:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 86us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.608955:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 287 00000100:00100000:2.0:1787833815.609070:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381894784 00000100:00100000:2.0:1787833815.609076:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381894784 00000100:00100000:2.0:1787833815.609133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381894656 00000100:00100000:2.0:1787833815.609136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381894656 00000100:00100000:2.0:1787833815.609156:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 109 00000100:00100000:2.0:1787833815.609163:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381894784:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833815.609197:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381894784:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 35us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833815.609203:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 109 00000100:00100000:2.0:1787833815.609216:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 110 00000100:00100000:2.0:1787833815.609222:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381894656:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833815.609247:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381894656:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 25us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833815.609252:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 110 00000100:00080000:0.0:1787833815.609991:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833815.609996:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787833815.830685:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833815.895240:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406083840:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.895308:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833815.895351:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406084352:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.895373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833815.895393:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406084864:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.895412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833815.895433:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787833815.895449:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406083712:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.895474:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833815.897090:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406083456:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.897159:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833815.897205:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406083968:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.897232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833815.897252:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406084480:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.897271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833815.897295:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787833815.897302:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406083584:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.897321:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833815.897338:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406084096:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.897358:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833815.897368:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406084608:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.897386:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833815.897413:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406084352 00000100:00100000:0.0:1787833815.897419:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406084352 00000100:00100000:0.0:1787833815.897467:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406084864 00000100:00100000:0.0:1787833815.897470:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406084864 00000100:00100000:0.0:1787833815.897509:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787833815.897518:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406084352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.897585:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406084352:12345-0@lo:400:kworker.0 Request processed in 69us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.897592:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787833815.897609:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787833815.897615:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406084864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.897643:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406084864:12345-0@lo:400:kworker.0 Request processed in 28us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.897648:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787833815.897666:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406083456 00000100:00100000:0.0:1787833815.897670:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406083456 00000100:00100000:0.0:1787833815.897694:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787833815.897701:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406083456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.897734:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406083456:12345-0@lo:400:kworker.0 Request processed in 34us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.897740:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787833815.897982:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406083840 00000100:00100000:0.0:1787833815.897988:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406083840 00000100:00100000:0.0:1787833815.898007:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406083968 00000100:00100000:0.0:1787833815.898009:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406083968 00000100:00100000:0.0:1787833815.898023:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406084480 00000100:00100000:0.0:1787833815.898025:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406084480 00000100:00100000:0.0:1787833815.898037:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406083584 00000100:00100000:0.0:1787833815.898039:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406083584 00000100:00100000:0.0:1787833815.898049:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406084096 00000100:00100000:0.0:1787833815.898051:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406084096 00000100:00100000:0.0:1787833815.898063:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406084608 00000100:00100000:0.0:1787833815.898065:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406084608 00000100:00100000:0.0:1787833815.898080:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787833815.898086:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406083840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.898130:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406083840:12345-0@lo:400:kworker.0 Request processed in 43us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.898136:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787833815.898148:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787833815.898154:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406083968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.898182:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406083968:12345-0@lo:400:kworker.0 Request processed in 28us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.898187:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787833815.898197:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787833815.898203:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406084480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.898227:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406084480:12345-0@lo:400:kworker.0 Request processed in 25us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.898233:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787833815.898243:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787833815.898248:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406083584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.898272:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406083584:12345-0@lo:400:kworker.0 Request processed in 25us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.898278:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787833815.898288:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787833815.898293:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406084096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.898319:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406084096:12345-0@lo:400:kworker.0 Request processed in 26us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.898324:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787833815.898334:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787833815.898341:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406084608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.898375:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406084608:12345-0@lo:400:kworker.0 Request processed in 35us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.898381:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1787833815.898400:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833815.898403:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833815.898406:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833815.898408:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833815.898455:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406083584:0@lo:400:kworker.0 00010000:00080000:0.0:1787833815.898469:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b39e00 x1874679406084096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833815.899348:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406084096:0@lo:400:kworker.0 00010000:00080000:0.0:1787833815.899372:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b3a940 x1874679406084608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833815.899380:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406084608:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.899391:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406083456:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.899400:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406083968:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.899409:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406084480:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.899621:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406084224:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.899662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833815.899675:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406084736:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.899692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833815.899712:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406083840:0@lo:400:kworker.0 00010000:00080000:3.0:1787833815.899722:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b3a1c0 x1874679406084352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833815.899730:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406084352:0@lo:400:kworker.0 00010000:00080000:3.0:1787833815.899739:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb870c0 x1874679406084864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833815.899746:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406084864:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.900022:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406083712 00000100:00100000:3.0:1787833815.900028:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406083712 00000100:00100000:3.0:1787833815.900072:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787833815.900079:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406083712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.900130:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406083712:12345-0@lo:400:kworker.0 Request processed in 51us (4655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833815.900136:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787833815.900164:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406083712:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.900302:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833815.900311:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406084992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833815.900339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833815.900365:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406084224 00000100:00100000:0.0:1787833815.900368:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406084224 00000100:00100000:0.0:1787833815.900400:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406084736 00000100:00100000:0.0:1787833815.900403:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406084736 00000100:00100000:0.0:1787833815.900437:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787833815.900442:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406084224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833815.900603:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406084992 00000100:00100000:1.0:1787833815.900606:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406084992 00000100:00100000:1.0:1787833815.900635:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787833815.900641:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874679406084992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833815.900663:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833815.900694:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874679406084992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.900699:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787833815.900717:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787833815.900724:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406084736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833815.900782:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406084736:12345-0@lo:400:kworker.0 Request processed in 26us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.900789:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787833815.900811:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406085120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833815.900836:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787833815.901037:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b38000 x1874679406084992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833815.901052:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406084992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833815.901073:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406085120 00000100:00100000:1.0:1787833815.901076:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406085120 00000100:00100000:1.0:1787833815.901098:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787833815.901104:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406085120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833815.901116:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833815.901147:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406085120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.901153:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787833815.901177:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5046d8f00 x1874679406085120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833815.901188:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406085120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833815.901385:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406084224:12345-0@lo:400:kworker.0 Request processed in 35us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.901395:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787833815.901417:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833815.901421:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833815.901443:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b38b40 x1874679406084224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833815.901452:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406084224:0@lo:400:kworker.0 00010000:00080000:0.0:1787833815.901460:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b3bc00 x1874679406084736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833815.901467:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406084736:0@lo:400:kworker.0 00000001:02000400:1.0:1787833816.767537:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 08:30:15 EDT 2026 00010000:00010000:3.0:1787833816.865092:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833816.918890:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833816.918923:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406085248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787833816.918989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833816.919052:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406085248 00000100:00100000:0.0:1787833816.919058:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406085248 00000100:00100000:0.0:1787833816.919102:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787833816.919111:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406085248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833816.919144:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787833816.919189:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406085248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833816.919196:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787833816.919239:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406085248:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787833817.878609:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833818.456147:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833818.456174:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406085376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833818.456233:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833818.456805:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406085376 00000100:00100000:1.0:1787833818.456814:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406085376 00000100:00100000:1.0:1787833818.456873:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787833818.456882:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406085376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833818.456922:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833818.456971:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406085376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833818.456978:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787833818.457019:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb870c0 x1874679406085376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833818.457050:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406085376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787833818.457807:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833818.457825:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406085504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787833818.457869:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833818.458006:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406085504 00000100:00100000:0.0:1787833818.458012:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406085504 00000100:00100000:0.0:1787833818.458057:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787833818.458065:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406085504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833818.458079:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833818.458117:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406085504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833818.458123:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787833818.460978:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833818.461027:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b3bc00 x1874679406085504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833818.461052:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406085504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787833818.919734:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833819.926155:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833820.501937:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833820.501961:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406085632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833820.502025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833820.502530:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406085632 00000100:00100000:3.0:1787833820.502538:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406085632 00000100:00100000:3.0:1787833820.502591:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787833820.502600:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406085632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787833820.502631:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833820.502683:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406085632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833820.502690:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787833820.502814:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406085632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833820.737343:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833820.737386:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833820.737533:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381895040 00000100:00100000:3.0:1787833820.737542:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381895040 00000100:00100000:3.0:1787833820.737612:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:3.0:1787833820.737621:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381895040:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833820.737689:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381895040:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 69us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833820.737696:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00080000:0.0:1787833820.737978:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833820.738222:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381894912 00000100:00100000:1.0:1787833820.738228:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381894912 00000100:00100000:1.0:1787833820.738265:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 289 00000100:00100000:1.0:1787833820.738273:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2398:x1874679381894912:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833820.738316:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2398:x1874679381894912:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 45us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833820.738322:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 289 00000100:00100000:0.0:1787833820.740855:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833820.741153:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381895168 00000100:00100000:1.0:1787833820.741162:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381895168 00000100:00100000:1.0:1787833820.741229:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:1.0:1787833820.741239:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381895168:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833820.741321:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381895168:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 84us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833820.741329:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00080000:0.0:1787833820.741384:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787833820.950375:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833821.016535:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833821.016559:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406085760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833821.016645:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833821.016723:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406085760 00000100:00100000:1.0:1787833821.016741:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406085760 00000100:00100000:1.0:1787833821.016813:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787833821.016822:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406085760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833821.016849:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833821.016910:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406085760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833821.016924:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787833821.016950:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787833821.016991:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5046d8f00 x1874679406085760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833821.017008:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406085760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833821.017426:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833821.017458:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406085888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833821.017496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833821.017617:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406085888 00000100:00100000:0.0:1787833821.017622:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406085888 00000100:00100000:0.0:1787833821.017665:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787833821.017672:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406085888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787833821.017687:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833821.017724:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406085888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833821.017743:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787833821.017890:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787833821.017916:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b38780 x1874679406085888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833821.017931:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406085888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833821.018191:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406086144:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018225:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.018254:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406086656:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.018295:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406087168:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.018348:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787833821.018353:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406086016:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018379:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.018397:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406086528:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018419:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.018435:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406087040:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.018489:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406086144 00000100:00100000:3.0:1787833821.018494:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406086144 00000100:00100000:3.0:1787833821.018519:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406086656 00000100:00100000:3.0:1787833821.018521:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406086656 00000100:00100000:3.0:1787833821.018540:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406087168 00000100:00100000:3.0:1787833821.018543:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406087168 00000100:00100000:3.0:1787833821.018557:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406086528 00000100:00100000:3.0:1787833821.018567:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406086528 00000100:00100000:3.0:1787833821.018582:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406087040 00000100:00100000:3.0:1787833821.018585:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406087040 00000100:00100000:3.0:1787833821.018599:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787833821.018605:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406086144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018648:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406086144:12345-0@lo:400:kworker.0 Request processed in 44us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.018655:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787833821.018670:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787833821.018677:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406086656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018704:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406086656:12345-0@lo:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.018709:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787833821.018719:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787833821.018725:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406087168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018790:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406087168:12345-0@lo:400:kworker.0 Request processed in 64us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.018795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787833821.018807:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787833821.018812:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406086528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.018836:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406086528:12345-0@lo:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.018841:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787833821.018852:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787833821.018857:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406087040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.019079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406087040:12345-0@lo:400:kworker.0 Request processed in 220us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.019092:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1787833821.019115:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833821.019119:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787833821.019128:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406086272:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.019159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.019179:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406086784:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.019199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.019215:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787833821.019220:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406086400:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.019240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.019255:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406086912:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.019274:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.019307:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406086528:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.019318:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406087040:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.019326:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406086144:0@lo:400:kworker.0 00010000:00080000:3.0:1787833821.019336:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef7c00 x1874679406086656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833821.019346:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406086656:0@lo:400:kworker.0 00010000:00080000:3.0:1787833821.019354:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef5a40 x1874679406087168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833821.019362:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406087168:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.019386:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406086400 00000100:00100000:3.0:1787833821.019395:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406086400 00000100:00100000:3.0:1787833821.019420:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787833821.019425:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406086400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833821.019684:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406086016 00000100:00100000:0.0:1787833821.019689:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406086016 00000100:00100000:3.0:1787833821.019867:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406086400:12345-0@lo:400:kworker.0 Request processed in 440us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.019875:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787833821.019991:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406086400:0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.020032:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406086272 00000100:00100000:3.0:1787833821.020036:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406086272 00000100:00100000:3.0:1787833821.020065:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787833821.020083:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406086272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833821.020125:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406086272:12345-0@lo:400:kworker.0 Request processed in 53us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.020130:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787833821.020158:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406086272:0@lo:400:kworker.0 00000100:00100000:0.0:1787833821.020230:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787833821.020238:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406086016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833821.020276:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406086016:12345-0@lo:400:kworker.0 Request processed in 40us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833821.020282:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787833821.020349:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406086016:0@lo:400:kworker.0 00000100:00100000:1.0:1787833821.020423:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406086784 00000100:00100000:1.0:1787833821.020427:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406086784 00000100:00100000:1.0:1787833821.020473:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406086912 00000100:00100000:1.0:1787833821.020476:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406086912 00000100:00100000:1.0:1787833821.020491:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787833821.020497:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406086784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833821.020536:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406086784:12345-0@lo:400:kworker.0 Request processed in 38us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833821.020542:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787833821.020552:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787833821.020558:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406086912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833821.020586:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406086912:12345-0@lo:400:kworker.0 Request processed in 28us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833821.020592:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787833821.020629:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef6580 x1874679406086912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833821.020639:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406086912:0@lo:400:kworker.0 00010000:00080000:1.0:1787833821.020649:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef5680 x1874679406086784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833821.020657:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406086784:0@lo:400:kworker.0 00000100:00080000:3.0:1787833821.024333:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787833821.974248:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833822.037903:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833822.037926:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406087296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787833822.038040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833822.038105:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406087296 00000100:00100000:0.0:1787833822.038112:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406087296 00000100:00100000:0.0:1787833822.038158:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787833822.038167:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406087296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833822.038199:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787833822.038248:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406087296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833822.038255:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787833822.038300:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406087296:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787833822.999624:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833823.576188:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406087424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833823.576257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833823.576325:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406087424 00000100:00100000:0.0:1787833823.576332:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406087424 00000100:00100000:0.0:1787833823.576380:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787833823.576390:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406087424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833823.576434:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833823.576478:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406087424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833823.576494:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787833823.576514:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833823.576543:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635b39e00 x1874679406087424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833823.576561:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406087424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833823.577158:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833823.577171:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406087552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833823.577206:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833823.577327:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406087552 00000100:00100000:2.0:1787833823.577333:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406087552 00000100:00100000:2.0:1787833823.577377:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787833823.577385:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406087552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833823.577400:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833823.577434:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406087552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833823.577447:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787833823.577494:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833823.577516:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef7840 x1874679406087552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833823.577528:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406087552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787833824.026195:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833825.046042:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833825.630846:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833825.630897:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406087680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833825.630977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833825.631039:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406087680 00000100:00100000:3.0:1787833825.631045:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406087680 00000100:00100000:3.0:1787833825.631217:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787833825.631227:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406087680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787833825.631259:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833825.631324:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406087680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833825.631332:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787833825.631384:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406087680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833825.854459:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833825.854505:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833825.854527:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833825.854554:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381895424 00000100:00100000:3.0:1787833825.854562:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381895424 00000100:00100000:3.0:1787833825.854612:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381895552 00000100:00100000:3.0:1787833825.854615:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381895552 00000100:00100000:0.0:1787833825.854620:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381895296 00000100:00100000:0.0:1787833825.854623:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381895296 00000100:00100000:3.0:1787833825.854637:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:3.0:1787833825.854646:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381895424:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833825.854647:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 291 00000100:00100000:0.0:1787833825.854652:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2400:x1874679381895296:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833825.854713:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381895424:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 67us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833825.854721:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:3.0:1787833825.854739:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:3.0:1787833825.854745:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381895552:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833825.862636:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2400:x1874679381895296:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 7970us (8118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833825.862652:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 291 00000100:00080000:0.0:1787833825.862721:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833825.862726:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833825.866439:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381895552:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 11682us (11898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833825.866454:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 126 00010000:00010000:1.0:1787833826.070927:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833826.134467:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406087936:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134588:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406088448:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134631:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406088960:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134649:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134669:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787833826.134674:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406087808:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134720:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406088320:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134787:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406088832:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134829:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406089344:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134890:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406088064:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134931:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406088576:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134964:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406089088:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.134983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.134995:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787833826.135016:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406088192:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135041:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.135053:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406088704:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135073:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.135091:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406089216:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833826.135142:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406087936 00000100:00100000:2.0:1787833826.135149:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406087936 00000100:00100000:2.0:1787833826.135199:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406088448 00000100:00100000:2.0:1787833826.135202:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406088448 00000100:00100000:2.0:1787833826.135227:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406088960 00000100:00100000:2.0:1787833826.135230:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406088960 00000100:00100000:2.0:1787833826.135243:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406088576 00000100:00100000:2.0:1787833826.135245:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406088576 00000100:00100000:2.0:1787833826.135257:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406089088 00000100:00100000:2.0:1787833826.135259:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406089088 00000100:00100000:2.0:1787833826.135271:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406088192 00000100:00100000:2.0:1787833826.135273:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406088192 00000100:00100000:2.0:1787833826.135288:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787833826.135296:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406087936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135350:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406087936:12345-0@lo:400:kworker.0 Request processed in 54us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.135357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787833826.135373:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787833826.135380:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406088448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135409:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406088448:12345-0@lo:400:kworker.0 Request processed in 30us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.135415:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787833826.135435:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787833826.135441:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406088960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135471:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406088960:12345-0@lo:400:kworker.0 Request processed in 31us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.135477:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787833826.135489:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787833826.135495:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406088576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135527:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406088576:12345-0@lo:400:kworker.0 Request processed in 32us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.135532:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787833826.135543:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787833826.135548:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c459a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406089088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135574:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c459a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406089088:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.135580:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787833826.135590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787833826.135596:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406088192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135621:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406088192:12345-0@lo:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.135626:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787833826.135649:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406087808 00000100:00100000:2.0:1787833826.135652:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406087808 00000100:00100000:2.0:1787833826.135671:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787833826.135676:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406087808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135703:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406087808:12345-0@lo:400:kworker.0 Request processed in 27us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.135716:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787833826.135746:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406088320 00000100:00100000:2.0:1787833826.135769:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406088320 00000100:00100000:2.0:1787833826.135791:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406088064 00000100:00100000:2.0:1787833826.135794:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406088064 00000100:00100000:2.0:1787833826.135806:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787833826.135812:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406088320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135844:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406088320:12345-0@lo:400:kworker.0 Request processed in 31us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.135864:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787833826.135876:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787833826.135881:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406088064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.135906:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406088064:12345-0@lo:400:kworker.0 Request processed in 25us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.135911:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787833826.135927:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406088832 00000100:00100000:2.0:1787833826.135931:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406088832 00000100:00100000:2.0:1787833826.135948:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406089344 00000100:00100000:2.0:1787833826.135950:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406089344 00000100:00100000:2.0:1787833826.135959:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406088704 00000100:00100000:2.0:1787833826.135961:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406088704 00000100:00100000:2.0:1787833826.135970:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406089216 00000100:00100000:2.0:1787833826.135972:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406089216 00000100:00100000:2.0:1787833826.135983:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787833826.135988:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406088832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136018:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406088832:12345-0@lo:400:kworker.0 Request processed in 30us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.136024:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787833826.136042:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787833826.136047:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406089344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136076:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406089344:12345-0@lo:400:kworker.0 Request processed in 30us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.136081:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787833826.136091:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787833826.136096:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406088704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136120:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406088704:12345-0@lo:400:kworker.0 Request processed in 24us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.136126:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787833826.136136:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787833826.136141:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406089216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136164:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406089216:12345-0@lo:400:kworker.0 Request processed in 23us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.136169:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787833826.136197:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833826.136202:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833826.136204:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833826.136206:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833826.136238:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406088192:0@lo:400:kworker.0 00010000:00080000:2.0:1787833826.136251:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef5a40 x1874679406088704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833826.136261:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406088704:0@lo:400:kworker.0 00010000:00080000:2.0:1787833826.136271:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef6d00 x1874679406089216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833826.136293:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406089216:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136306:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406088064:0@lo:400:kworker.0 00010000:00080000:2.0:1787833826.136316:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef4000 x1874679406088576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833826.136324:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406088576:0@lo:400:kworker.0 00010000:00080000:2.0:1787833826.136332:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef4f00 x1874679406089088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833826.136338:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406089088:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136372:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406087808:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136382:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406088320:0@lo:400:kworker.0 00010000:00080000:2.0:1787833826.136391:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef7c00 x1874679406088832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833826.136398:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406088832:0@lo:400:kworker.0 00010000:00080000:2.0:1787833826.136406:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a47c00 x1874679406089344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833826.136413:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406089344:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136421:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406087936:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136430:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406088448:0@lo:400:kworker.0 00000100:00100000:2.0:1787833826.136438:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406088960:0@lo:400:kworker.0 00000100:00100000:3.0:1787833826.142314:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833826.142386:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406089472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833826.142475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833826.142839:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406089472 00000100:00100000:0.0:1787833826.142859:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406089472 00000100:00100000:0.0:1787833826.142914:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787833826.142924:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406089472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833826.142965:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833826.143018:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406089472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833826.143026:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787833826.143067:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba7480 x1874679406089472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833826.143087:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406089472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833826.143497:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406089600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833826.143553:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833826.143668:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406089600 00000100:00100000:0.0:1787833826.143673:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406089600 00000100:00100000:0.0:1787833826.143701:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787833826.143709:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406089600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787833826.143722:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833826.152714:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406089600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8997us (9152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833826.152729:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787833826.158538:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5025083c0 x1874679406089600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833826.158564:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406089600:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787833827.093964:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833827.166558:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406089728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787833827.166632:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833827.166713:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406089728 00000100:00100000:3.0:1787833827.166720:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406089728 00000100:00100000:3.0:1787833827.166787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787833827.166796:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406089728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787833827.166828:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787833827.166901:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406089728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833827.166908:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787833827.166951:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406089728:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787833828.122604:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833828.694546:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406089856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833828.694626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833828.694711:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833828.694718:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406089984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833828.694743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833828.694949:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406089856 00000100:00100000:2.0:1787833828.694956:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406089856 00000100:00100000:2.0:1787833828.695016:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406089984 00000100:00100000:2.0:1787833828.695020:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406089984 00000100:00100000:2.0:1787833828.695040:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787833828.695049:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406089856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787833828.695078:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833828.695125:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406089856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833828.695133:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787833828.695149:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787833828.695156:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406089984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833828.695166:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833828.695191:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406089984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833828.695198:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1787833828.695249:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502508000 x1874679406089984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833828.695267:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406089984:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787833828.695279:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba1e00 x1874679406089856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833828.695311:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406089856:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787833828.696161:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787833829.142685:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833830.170239:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833830.743221:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833830.743243:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406090112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833830.743323:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833830.743392:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406090112 00000100:00100000:0.0:1787833830.743399:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406090112 00000100:00100000:0.0:1787833830.743450:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787833830.743458:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406090112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787833830.743490:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787833830.743535:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406090112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833830.743542:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787833830.743586:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406090112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833830.969351:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833830.969399:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833830.969432:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833830.969463:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381895808 00000100:00100000:3.0:1787833830.969472:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381895808 00000100:00100000:3.0:1787833830.969524:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381895936 00000100:00100000:3.0:1787833830.969527:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381895936 00000100:00100000:3.0:1787833830.969549:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:3.0:1787833830.969557:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381895808:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833830.969624:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381895808:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 68us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833830.969631:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:3.0:1787833830.969680:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:3.0:1787833830.969687:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381895936:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833830.969712:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381895936:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833830.969718:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00080000:3.0:1787833830.969733:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787833830.969737:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833830.971864:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381895680 00000100:00100000:0.0:1787833830.971878:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381895680 00000100:00100000:0.0:1787833830.971943:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 293 00000100:00100000:0.0:1787833830.971953:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2401:x1874679381895680:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833830.972022:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2401:x1874679381895680:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 71us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833830.972029:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 293 00010000:00010000:2.0:1787833831.190002:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833831.254036:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406090240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833831.254107:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833831.254186:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406090240 00000100:00100000:0.0:1787833831.254193:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406090240 00000100:00100000:0.0:1787833831.254255:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787833831.254263:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406090240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833831.254289:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833831.254330:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406090240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833831.254337:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787833831.254355:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787833831.254385:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba4b40 x1874679406090240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833831.254415:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406090240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833831.254445:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833831.254451:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406090624:0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.254481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.254489:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833831.254498:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406090752:0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.254505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406090624 00000100:00100000:0.0:1787833831.254508:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406090624 00000100:00100000:1.0:1787833831.254526:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833831.254531:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787833831.254537:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620574050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406090624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.254572:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406091136:0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.254572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620574050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406090624:12345-0@lo:400:kworker.0 Request processed in 34us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833831.254578:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787833831.254592:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.254649:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406091648:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.254669:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.254682:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787833831.254686:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406091264:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.254704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.254717:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406091776:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.254731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.254808:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406090624:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.254864:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406090368:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.254892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.254914:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406090880:0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.254997:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406090368 00000100:00100000:0.0:1787833831.255001:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406090368 00000100:00100000:0.0:1787833831.255025:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787833831.255032:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406090368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.255064:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406090368:12345-0@lo:400:kworker.0 Request processed in 32us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833831.255070:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787833831.255341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.255381:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406091392:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.255404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.255420:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406091904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833831.255438:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.255594:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406090368:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.255615:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787833831.255623:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406090496:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.255646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.255663:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406091008:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.255683:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.255693:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406091520:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.255724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833831.255782:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406091904 00000100:00100000:1.0:1787833831.255787:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406091904 00000100:00100000:1.0:1787833831.255830:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787833831.255838:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406091904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833831.255852:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833831.255888:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406091904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.255894:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1787833831.255922:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5046db480 x1874679406091904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833831.255937:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406091904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833831.255969:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406091264 00000100:00100000:1.0:1787833831.256085:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406091264 00000100:00100000:1.0:1787833831.256112:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406091776 00000100:00100000:1.0:1787833831.256114:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406091776 00000100:00100000:1.0:1787833831.256123:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406091392 00000100:00100000:1.0:1787833831.256125:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406091392 00000100:00100000:1.0:1787833831.256136:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787833831.256141:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406091264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.256184:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406091264:12345-0@lo:400:kworker.0 Request processed in 42us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.256191:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787833831.256202:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787833831.256208:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406091776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.256231:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406091776:12345-0@lo:400:kworker.0 Request processed in 24us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.256236:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787833831.256245:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787833831.256250:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406091392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.256279:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406091392:12345-0@lo:400:kworker.0 Request processed in 28us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.256285:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787833831.256314:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba1e00 x1874679406091264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833831.256324:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406091264:0@lo:400:kworker.0 00010000:00080000:1.0:1787833831.256335:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba0000 x1874679406091776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833831.256342:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406091776:0@lo:400:kworker.0 00010000:00080000:1.0:1787833831.256364:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba3840 x1874679406091392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833831.256535:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406091392:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.256577:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406090752 00000100:00100000:1.0:1787833831.256586:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406090752 00000100:00100000:1.0:1787833831.256606:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406091136 00000100:00100000:1.0:1787833831.256609:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406091136 00000100:00100000:1.0:1787833831.256620:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406091648 00000100:00100000:1.0:1787833831.256623:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406091648 00000100:00100000:1.0:1787833831.256633:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406090496 00000100:00100000:1.0:1787833831.256636:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406090496 00000100:00100000:1.0:1787833831.256644:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406091008 00000100:00100000:1.0:1787833831.256646:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406091008 00000100:00100000:1.0:1787833831.256656:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406091520 00000100:00100000:1.0:1787833831.256659:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406091520 00000100:00100000:1.0:1787833831.256672:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787833831.256677:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406090752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.256717:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406090752:12345-0@lo:400:kworker.0 Request processed in 39us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.256722:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787833831.256734:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787833831.256740:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406091136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.256879:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406091136:12345-0@lo:400:kworker.0 Request processed in 138us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.256885:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787833831.256897:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787833831.256903:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406091648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.256930:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406091648:12345-0@lo:400:kworker.0 Request processed in 27us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.256935:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787833831.256945:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787833831.256950:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406090496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.257085:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406090880 00000100:00100000:0.0:1787833831.257090:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406090880 00000100:00100000:0.0:1787833831.257119:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787833831.257126:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406090880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.257167:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406090880:12345-0@lo:400:kworker.0 Request processed in 42us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833831.257173:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787833831.257199:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833831.257202:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833831.257205:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833831.257207:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833831.257231:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406090880:0@lo:400:kworker.0 00010000:00080000:0.0:1787833831.257266:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba30c0 x1874679406091648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833831.257276:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406091648:0@lo:400:kworker.0 00010000:00080000:0.0:1787833831.257286:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba1680 x1874679406091136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833831.257294:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406091136:0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.257303:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406090752:0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.257481:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406090496:12345-0@lo:400:kworker.0 Request processed in 530us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.257487:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787833831.257500:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787833831.257507:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406091008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.257534:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406091008:12345-0@lo:400:kworker.0 Request processed in 29us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.257540:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787833831.257550:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787833831.257556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406091520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833831.257583:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406091520:12345-0@lo:400:kworker.0 Request processed in 27us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833831.257588:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787833831.260357:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406090496:0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.260389:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406091008:0@lo:400:kworker.0 00000100:00100000:0.0:1787833831.260404:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406091520:0@lo:400:kworker.0 00010000:00010000:2.0:1787833832.217357:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833832.279486:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833832.279519:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406092032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787833832.279586:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833832.279828:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406092032 00000100:00100000:2.0:1787833832.279835:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406092032 00000100:00100000:2.0:1787833832.279886:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787833832.279896:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406092032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787833832.279926:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787833832.279972:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406092032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833832.279979:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787833832.280297:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406092032:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787833833.238082:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787833833.709850:0:11993:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:30:32 (1787833832) === 00000100:00100000:3.0:1787833833.818775:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833833.818811:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406092160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833833.818883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833833.818949:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406092160 00000100:00100000:3.0:1787833833.818956:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406092160 00000100:00100000:3.0:1787833833.819007:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787833833.819015:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406092160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833833.819041:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833833.819084:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406092160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833833.819092:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1787833833.819113:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833833.819142:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba5680 x1874679406092160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833833.819160:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406092160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833833.831700:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833833.831733:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406092288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833833.831833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833833.831886:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406092288 00000100:00100000:0.0:1787833833.831894:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406092288 00000100:00100000:0.0:1787833833.831947:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787833833.831966:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406092288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833833.831991:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833833.832035:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406092288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833833.832044:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787833833.832080:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50399e580 x1874679406092288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833833.832097:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406092288:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787833833.832691:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833834.189279:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833834.189370:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381896064 00000100:00100000:2.0:1787833834.189379:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381896064 00000100:00100000:2.0:1787833834.189430:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 295 00000100:00100000:2.0:1787833834.189441:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:8721:x1874679381896064:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787833834.189457:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833834.189475:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d3e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ea88 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833834.189502:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea88 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833834.189512:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea88 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833834.189540:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f200, rc 0) 00000100:00100000:2.0:1787833834.189600:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8721:x1874679381896064:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 161us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.189607:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 295 00000100:00100000:0.0:1787833834.203993:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833834.204329:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381896192 00000100:00100000:2.0:1787833834.204340:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381896192 00000100:00100000:2.0:1787833834.204401:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 296 00000100:00100000:2.0:1787833834.204410:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8721:x1874679381896192:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787833834.204561:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8721:x1874679381896192:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 152us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.204569:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 296 00000100:00100000:3.0:1787833834.214133:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833834.214397:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381896320 00000100:00100000:0.0:1787833834.214406:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381896320 00000100:00100000:0.0:1787833834.214461:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 297 00000100:00100000:0.0:1787833834.214470:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8721:x1874679381896320:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787833834.214611:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8721:x1874679381896320:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 140us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833834.214619:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 297 00000100:00100000:1.0:1787833834.227548:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833834.228065:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381896448 00000100:00100000:3.0:1787833834.228077:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381896448 00000100:00100000:3.0:1787833834.228134:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 298 00000100:00100000:3.0:1787833834.228145:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8725:x1874679381896448:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787833834.228295:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8725:x1874679381896448:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 151us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833834.228303:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 298 00010000:00010000:2.0:1787833834.262044:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833834.264686:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833834.264845:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381896576 00000100:00100000:2.0:1787833834.264852:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381896576 00000100:00100000:2.0:1787833834.264906:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 299 00000100:00100000:2.0:1787833834.264915:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8725:x1874679381896576:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833834.265079:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8725:x1874679381896576:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 164us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.265087:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 299 00000100:00100000:1.0:1787833834.269942:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833834.270098:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381896704 00000100:00100000:0.0:1787833834.270107:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381896704 00000100:00100000:0.0:1787833834.270160:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 300 00000100:00100000:0.0:1787833834.270170:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8725:x1874679381896704:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787833834.270309:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8725:x1874679381896704:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 140us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833834.270316:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 300 00000100:00100000:1.0:1787833834.278701:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833834.278774:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381896832 00000100:00100000:3.0:1787833834.278784:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381896832 00000100:00100000:3.0:1787833834.278849:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 301 00000100:00100000:3.0:1787833834.278859:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:8721:x1874679381896832:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787833834.278876:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833834.278893:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d3f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eab9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833834.278917:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d3f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eab9 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833834.278928:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d3f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eab9 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833834.278937:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246400, rc 0) 00000100:00100000:3.0:1787833834.278991:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:8721:x1874679381896832:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 133us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833834.278998:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 301 00000100:00100000:1.0:1787833834.285003:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833834.285178:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381896960 00000100:00100000:2.0:1787833834.285187:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381896960 00000100:00100000:2.0:1787833834.285244:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 302 00000100:00100000:2.0:1787833834.285254:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:8721:x1874679381896960:12345-192.168.203.17@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787833834.285278:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787833834.285305:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787833834.285309:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787833834.285311:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787833834.285314:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787833834.285316:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787833834.289562:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:8721:x1874679381896960:12345-192.168.203.17@tcp:256:mount.lustre.0 Request processed in 4300us (4558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.289575:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 302 00000100:00100000:1.0:1787833834.292403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833834.292496:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381897088 00000100:00100000:0.0:1787833834.292504:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381897088 00000100:00100000:0.0:1787833834.292573:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 303 00000100:00100000:0.0:1787833834.292584:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:8721:x1874679381897088:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787833834.292600:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833834.292617:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eac0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833834.292654:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eac0 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833834.292666:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eac0 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833834.292675:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7200, rc 0) 00000100:00100000:0.0:1787833834.292737:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:8721:x1874679381897088:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 154us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833834.292744:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 303 00000100:00100000:1.0:1787833834.297522:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833834.297726:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381897216 00000100:00100000:2.0:1787833834.297737:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381897216 00000100:00100000:2.0:1787833834.297873:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 304 00000100:00100000:2.0:1787833834.297883:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:8721:x1874679381897216:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787833834.298035:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:8721:x1874679381897216:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 153us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.298043:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 304 00000100:00100000:1.0:1787833834.303840:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833834.303925:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381897344 00000100:00100000:3.0:1787833834.303935:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381897344 00000100:00100000:3.0:1787833834.303998:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 305 00000100:00100000:3.0:1787833834.304009:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:8721:x1874679381897344:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787833834.304161:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:8721:x1874679381897344:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833834.304170:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 305 00000100:00100000:1.0:1787833834.314901:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833834.315329:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381897472 00000100:00100000:2.0:1787833834.315338:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381897472 00000100:00100000:2.0:1787833834.315394:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 306 00000100:00100000:2.0:1787833834.315403:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:8729:x1874679381897472:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833834.315540:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:8729:x1874679381897472:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 138us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.315548:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 306 00000100:00100000:1.0:1787833834.322846:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833834.325227:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381897600 00000100:00100000:0.0:1787833834.325240:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381897600 00000100:00100000:0.0:1787833834.325301:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 307 00000100:00100000:0.0:1787833834.325310:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:8729:x1874679381897600:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787833834.326479:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:8729:x1874679381897600:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 1161us (3633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833834.326491:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 307 00000100:00100000:1.0:1787833834.334432:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833834.334492:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833834.334517:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833834.334550:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833834.334681:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381897728 00000100:00100000:2.0:1787833834.334691:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381897728 00000100:00100000:2.0:1787833834.334721:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381897984 00000100:00100000:2.0:1787833834.334724:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381897984 00000100:00100000:2.0:1787833834.334731:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381898112 00000100:00100000:2.0:1787833834.334733:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381898112 00000100:00100000:2.0:1787833834.334821:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381898240 00000100:00100000:2.0:1787833834.334824:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381898240 00000100:00100000:2.0:1787833834.334842:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:2.0:1787833834.334851:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381898112:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833834.334913:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381898112:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 62us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.334919:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:2.0:1787833834.334945:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:2.0:1787833834.334953:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381898240:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833834.334977:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381898240:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 25us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.334983:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:2.0:1787833834.334995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1787833834.334999:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1874679381897728:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787833834.335030:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 4c5eda4b-a2af-428f-9382-408414ba28ec@192.168.203.17@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:2.0:1787833834.335070:0:6515:0:(genops.c:1385:class_connect()) connect: client 4c5eda4b-a2af-428f-9382-408414ba28ec, cookie 0x996d2fb20dc1d3fe 00000004:00100000:2.0:1787833834.335094:0:6515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787833834.335193:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8df5038ac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833834.335221:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2397:x1874679381897728:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 220us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.335228:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1787833834.335242:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1787833834.335246:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1874679381897984:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787833834.335259:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 4c5eda4b-a2af-428f-9382-408414ba28ec@192.168.203.17@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:2.0:1787833834.335287:0:6515:0:(genops.c:1385:class_connect()) connect: client 4c5eda4b-a2af-428f-9382-408414ba28ec, cookie 0x996d2fb20dc1d405 00000004:00100000:2.0:1787833834.335300:0:6515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787833834.335388:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8df5038a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833834.335412:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2397:x1874679381897984:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 164us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.335418:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00080000:1.0:1787833834.336498:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833834.336505:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833834.340961:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833834.341002:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833834.341342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381898368 00000100:00100000:3.0:1787833834.341352:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381898368 00000100:00100000:3.0:1787833834.341426:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381897856 00000100:00100000:3.0:1787833834.341430:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381897856 00000100:00100000:3.0:1787833834.341460:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1787833834.341469:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:0:x1874679381898368:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787833834.341503:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833834.341590:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:0:x1874679381898368:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 122us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833834.341597:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1787833834.341615:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:3.0:1787833834.341622:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:0:x1874679381897856:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787833834.341638:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787833834.341674:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:0:x1874679381897856:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 52us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833834.341680:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00080000:1.0:1787833834.342842:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833834.342848:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787833834.347576:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833834.351327:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381898496 00000100:00100000:3.0:1787833834.351341:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381898496 00000100:00100000:3.0:1787833834.351426:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1787833834.351446:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:8721:x1874679381898496:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787833834.351492:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787833834.352801:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:8721:x1874679381898496:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 1346us (5213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833834.352815:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1787833834.357864:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833834.357964:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381898624 00000100:00100000:0.0:1787833834.357973:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381898624 00000100:00100000:0.0:1787833834.358042:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787833834.358052:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+6:8721:x1874679381898624:12345-192.168.203.17@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787833834.358432:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+6:8721:x1874679381898624:12345-192.168.203.17@tcp:40:mount.lustre.0 Request processed in 378us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833834.358442:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787833834.367260:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833834.367294:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833834.367376:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833834.367478:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381898752 00000100:00100000:2.0:1787833834.367487:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381898752 00000100:00100000:2.0:1787833834.367530:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381898880 00000100:00100000:2.0:1787833834.367535:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381898880 00000100:00100000:2.0:1787833834.367554:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1787833834.367562:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1874679381898752:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787833834.367595:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 4c5eda4b-a2af-428f-9382-408414ba28ec@192.168.203.17@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:2.0:1787833834.367632:0:8430:0:(genops.c:1385:class_connect()) connect: client 4c5eda4b-a2af-428f-9382-408414ba28ec, cookie 0x996d2fb20dc1d40c 00002000:00100000:2.0:1787833834.367644:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c5eda4b-a2af-428f-9382-408414ba28ec/ffff8df63c480000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787833834.367656:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787833834.367730:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787833834.367782:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8df63c483000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833834.367854:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2397:x1874679381898752:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 291us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.367861:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1787833834.367878:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:2.0:1787833834.367882:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1874679381898880:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787833834.367897:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 4c5eda4b-a2af-428f-9382-408414ba28ec@192.168.203.17@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:2.0:1787833834.367914:0:8430:0:(genops.c:1385:class_connect()) connect: client 4c5eda4b-a2af-428f-9382-408414ba28ec, cookie 0x996d2fb20dc1d413 00002000:00100000:2.0:1787833834.367946:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c5eda4b-a2af-428f-9382-408414ba28ec/ffff8df63c487800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787833834.367958:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787833834.367992:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787833834.368009:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8df63c3b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833834.368159:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2397:x1874679381898880:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 275us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.368166:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:3.0:1787833834.368562:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381899008 00000100:00100000:3.0:1787833834.368568:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381899008 00000100:00100000:3.0:1787833834.368611:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1787833834.368618:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:8721:x1874679381899008:12345-192.168.203.17@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787833834.368656:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:8721:x1874679381899008:12345-192.168.203.17@tcp:900:mount.lustre.0 Request processed in 38us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833834.368663:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:1.0:1787833834.379913:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833834.380121:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381899136 00000100:00100000:2.0:1787833834.380130:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381899136 00000100:00100000:2.0:1787833834.380185:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:2.0:1787833834.380195:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+6:8721:x1874679381899136:12345-192.168.203.17@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787833834.380281:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787833834.380408:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+6:8721:x1874679381899136:12345-192.168.203.17@tcp:33:mount.lustre.0 Request processed in 214us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833834.380417:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00010000:00010000:3.0:1787833835.285887:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833835.861912:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833835.861938:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406092416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833835.862049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833835.862144:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406092416 00000100:00100000:0.0:1787833835.862151:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406092416 00000100:00100000:0.0:1787833835.862202:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787833835.862211:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406092416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787833835.862243:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787833835.862300:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406092416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833835.862306:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787833835.862360:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406092416:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787833836.310039:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833836.374296:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406092800:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.374368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.374524:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406093312:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.374552:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.374577:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406093824:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.374619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.374648:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406094336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833836.374672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.374702:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787833836.374708:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406092672:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.374730:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.374748:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406093184:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.374796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.374922:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406093696:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.374943:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.374952:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406094208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833836.374968:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.375007:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406093312 00000100:00100000:3.0:1787833836.375014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406093312 00000100:00100000:3.0:1787833836.375057:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406093824 00000100:00100000:3.0:1787833836.375060:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406093824 00000100:00100000:3.0:1787833836.375075:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406092672 00000100:00100000:3.0:1787833836.375077:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406092672 00000100:00100000:3.0:1787833836.375086:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406093184 00000100:00100000:3.0:1787833836.375088:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406093184 00000100:00100000:3.0:1787833836.375097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406093696 00000100:00100000:3.0:1787833836.375099:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406093696 00000100:00100000:3.0:1787833836.375112:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787833836.375120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406093312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.375173:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406093312:12345-0@lo:400:kworker.0 Request processed in 53us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.375180:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787833836.375197:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787833836.375203:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406093824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.375229:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406093824:12345-0@lo:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.375244:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787833836.375259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787833836.375265:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406092672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.375293:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406092672:12345-0@lo:400:kworker.0 Request processed in 29us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.375298:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787833836.375308:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787833836.375313:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406093184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.375337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406093184:12345-0@lo:400:kworker.0 Request processed in 24us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.375342:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787833836.375352:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787833836.375358:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406093696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.375380:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406093696:12345-0@lo:400:kworker.0 Request processed in 23us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.375385:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787833836.375401:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406094336 00000100:00100000:3.0:1787833836.375404:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406094336 00000100:00100000:3.0:1787833836.375426:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406094208 00000100:00100000:3.0:1787833836.375429:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406094208 00000100:00100000:3.0:1787833836.375443:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787833836.375449:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406094336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833836.375470:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833836.375498:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406094336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.375514:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787833836.375525:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787833836.375530:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406094208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787833836.375539:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833836.375561:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406094208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.375566:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787833836.375598:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406092672:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.375609:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406093184:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.375618:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406093696:0@lo:400:kworker.0 00010000:00080000:3.0:1787833836.375630:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50399c780 x1874679406094208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833836.375644:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406094208:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787833836.375654:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50399f0c0 x1874679406094336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833836.375665:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406094336:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787833836.375675:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50250a940 x1874679406093312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833836.375683:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406093312:0@lo:400:kworker.0 00010000:00080000:3.0:1787833836.375691:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a46d00 x1874679406093824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833836.375712:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406093824:0@lo:400:kworker.0 00000100:00100000:0.0:1787833836.376327:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406092800 00000100:00100000:0.0:1787833836.376334:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406092800 00000100:00100000:0.0:1787833836.376365:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787833836.376372:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406092800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833836.376426:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406092800:12345-0@lo:400:kworker.0 Request processed in 54us (2058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833836.376432:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787833836.376460:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406092800:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.376536:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406092544:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.376571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.376599:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406093056:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.376621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.376635:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406093568:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.376657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833836.376657:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406092928:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.376678:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406094080:0@lo:400:kworker.0 00000100:00100000:1.0:1787833836.376685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.376695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833836.376703:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406093440:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.376722:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406092544 00000100:00100000:1.0:1787833836.376723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.376725:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406092544 00000100:00100000:1.0:1787833836.376739:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406093952:0@lo:400:kworker.0 00000100:00100000:1.0:1787833836.376785:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833836.377340:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787833836.377350:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406092544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.377399:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406092544:12345-0@lo:400:kworker.0 Request processed in 51us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.377405:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787833836.377438:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406093056 00000100:00100000:3.0:1787833836.377443:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406093056 00000100:00100000:3.0:1787833836.377467:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787833836.377473:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406093056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.377504:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406093056:12345-0@lo:400:kworker.0 Request processed in 32us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.377510:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787833836.377536:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406092544:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.377562:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406093056:0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.377603:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406093568 00000100:00100000:3.0:1787833836.377606:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406093568 00000100:00100000:0.0:1787833836.377813:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406094080 00000100:00100000:0.0:1787833836.377818:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406094080 00000100:00100000:3.0:1787833836.377869:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406093440 00000100:00100000:3.0:1787833836.377873:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406093440 00000100:00100000:1.0:1787833836.378213:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406093952 00000100:00100000:1.0:1787833836.378218:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406093952 00000100:00100000:2.0:1787833836.380692:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787833836.380719:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406093568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833836.380845:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406093568:12345-0@lo:400:kworker.0 Request processed in 140us (4186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833836.380852:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787833836.381974:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787833836.381990:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406094080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833836.382071:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406094080:12345-0@lo:400:kworker.0 Request processed in 88us (5374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833836.382078:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787833836.382104:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833836.382109:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833836.382113:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833836.382115:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833836.382128:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406092928 00000100:00100000:0.0:1787833836.382135:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406092928 00000100:00100000:0.0:1787833836.382175:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787833836.382182:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406092928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833836.382233:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406092928:12345-0@lo:400:kworker.0 Request processed in 52us (5547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833836.382241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787833836.385241:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787833836.385266:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406093440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833836.385349:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406093440:12345-0@lo:400:kworker.0 Request processed in 96us (8624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833836.385356:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787833836.386634:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787833836.386651:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406093952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833836.386723:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406093952:12345-0@lo:400:kworker.0 Request processed in 80us (9947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833836.386739:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787833836.391514:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406092928:0@lo:400:kworker.0 00010000:00080000:1.0:1787833836.391534:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a47840 x1874679406093440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833836.391544:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406093440:0@lo:400:kworker.0 00010000:00080000:1.0:1787833836.391554:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a44000 x1874679406093952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833836.391584:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406093952:0@lo:400:kworker.0 00010000:00080000:2.0:1787833836.391694:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a44b40 x1874679406093568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833836.392527:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406093568:0@lo:400:kworker.0 00010000:00080000:2.0:1787833836.392553:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a47c00 x1874679406094080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833836.392563:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406094080:0@lo:400:kworker.0 00010000:00010000:3.0:1787833837.342025:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833837.398981:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833837.399004:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406094464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787833837.399071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833837.399167:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406094464 00000100:00100000:0.0:1787833837.399174:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406094464 00000100:00100000:0.0:1787833837.399220:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787833837.399228:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406094464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833837.399260:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787833837.399374:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406094464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833837.399382:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787833837.399424:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406094464:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787833838.358075:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833838.934183:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406094592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787833838.934258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833838.934502:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833838.934514:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406094720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833838.934543:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833838.934781:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406094592 00000100:00100000:3.0:1787833838.934789:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406094592 00000100:00100000:3.0:1787833838.934841:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406094720 00000100:00100000:3.0:1787833838.934844:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406094720 00000100:00100000:3.0:1787833838.934861:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787833838.934869:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406094592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787833838.934898:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833838.934947:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406094592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833838.934954:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787833838.934985:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787833838.934991:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406094720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833838.935001:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833838.935028:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406094720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833838.935034:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787833838.935069:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50399f840 x1874679406094592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833838.935088:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406094592:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787833838.935278:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833838.935309:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50399de00 x1874679406094720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833838.935322:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406094720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787833839.384163:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833839.683493:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833839.683547:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833839.683576:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833839.683616:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833839.683644:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833839.683664:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833839.683707:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833839.683788:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381899392 00000100:00100000:0.0:1787833839.683796:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381899392 00000100:00100000:0.0:1787833839.683846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381899520 00000100:00100000:0.0:1787833839.683849:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381899520 00000100:00100000:0.0:1787833839.683862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381899776 00000100:00100000:0.0:1787833839.683864:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381899776 00000100:00100000:0.0:1787833839.683874:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381899648 00000100:00100000:0.0:1787833839.683876:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381899648 00000100:00100000:0.0:1787833839.683890:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 149 00000100:00100000:0.0:1787833839.683898:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381899392:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833839.683968:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381899392:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 69us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833839.683975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 149 00000100:00100000:0.0:1787833839.683992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 150 00000100:00100000:0.0:1787833839.683998:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381899520:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833839.684023:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381899520:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833839.684044:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 150 00000100:00100000:0.0:1787833839.684057:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 151 00000100:00100000:0.0:1787833839.684063:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2401:x1874679381899776:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833839.684089:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2401:x1874679381899776:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833839.684095:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 151 00000100:00100000:0.0:1787833839.684105:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 152 00000100:00100000:0.0:1787833839.684111:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2400:x1874679381899648:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833839.684132:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2400:x1874679381899648:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 21us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833839.684137:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 152 00000100:00100000:0.0:1787833839.684159:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381900032 00000100:00100000:0.0:1787833839.684162:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381900032 00000100:00100000:0.0:1787833839.684186:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381899904 00000100:00100000:0.0:1787833839.684189:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381899904 00000100:00100000:0.0:1787833839.684208:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:0.0:1787833839.684214:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2401:x1874679381900032:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833839.684240:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2401:x1874679381900032:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833839.684246:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:0.0:1787833839.684258:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:0.0:1787833839.684263:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2400:x1874679381899904:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833839.684285:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2400:x1874679381899904:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 22us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833839.684298:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00080000:0.0:1787833839.684315:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833839.684318:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833839.684320:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833839.684323:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833839.685285:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381899264 00000100:00100000:2.0:1787833839.685294:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381899264 00000100:00100000:2.0:1787833839.685339:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 309 00000100:00100000:2.0:1787833839.685347:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381899264:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833839.685406:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381899264:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 59us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833839.685413:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 309 00000001:02000400:3.0:1787833839.859955:0:12186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:0.0:1787833839.970852:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c5eda4b-a2af-428f-9382-408414ba28ec 00000001:00100000:2.0:1787833839.975228:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c5eda4b-a2af-428f-9382-408414ba28ec 00000001:00100000:0.0:1787833839.975318:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c5eda4b-a2af-428f-9382-408414ba28ec 00000001:00100000:3.0:1787833839.976882:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4c5eda4b-a2af-428f-9382-408414ba28ec 00010000:00010000:3.0:1787833840.406089:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833840.982697:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833840.982794:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406094848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833840.982865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833840.982932:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406094848 00000100:00100000:3.0:1787833840.982940:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406094848 00000100:00100000:3.0:1787833840.982982:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787833840.982990:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406094848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787833840.983017:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833840.983057:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406094848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833840.983064:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787833840.983111:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406094848:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787833841.430282:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833841.493963:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406095104:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494083:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406095616:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494129:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406096128:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494175:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787833841.494182:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406094976:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494208:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494227:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406095488:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494281:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406096000:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494322:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406096512:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494382:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406095232:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494404:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494423:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406095744:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494441:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494457:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406096256:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494476:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494488:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787833841.494494:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406095360:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494530:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406095872:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494547:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494562:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406096384:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494579:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.494621:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406095104 00000100:00100000:2.0:1787833841.494628:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406095104 00000100:00100000:2.0:1787833841.494663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406095616 00000100:00100000:2.0:1787833841.494666:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406095616 00000100:00100000:2.0:1787833841.494685:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406096128 00000100:00100000:2.0:1787833841.494687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406096128 00000100:00100000:2.0:1787833841.494698:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406095744 00000100:00100000:2.0:1787833841.494700:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406095744 00000100:00100000:2.0:1787833841.494723:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406096256 00000100:00100000:2.0:1787833841.494726:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406096256 00000100:00100000:2.0:1787833841.494736:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406095360 00000100:00100000:2.0:1787833841.494775:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406095360 00000100:00100000:2.0:1787833841.494794:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787833841.494802:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406095104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494855:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406095104:12345-0@lo:400:kworker.0 Request processed in 54us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.494862:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787833841.494878:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787833841.494884:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406095616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494909:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406095616:12345-0@lo:400:kworker.0 Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.494914:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787833841.494925:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787833841.494930:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406096128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.494954:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406096128:12345-0@lo:400:kworker.0 Request processed in 24us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.494960:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787833841.494971:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787833841.494976:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406095744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495005:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406095744:12345-0@lo:400:kworker.0 Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495011:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787833841.495021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787833841.495026:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406096256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495062:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406096256:12345-0@lo:400:kworker.0 Request processed in 36us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495067:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787833841.495077:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787833841.495082:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406095360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406095360:12345-0@lo:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495110:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787833841.495148:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406094976 00000100:00100000:2.0:1787833841.495152:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406094976 00000100:00100000:2.0:1787833841.495176:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787833841.495181:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406094976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495210:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406094976:12345-0@lo:400:kworker.0 Request processed in 29us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495216:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787833841.495242:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406095488 00000100:00100000:2.0:1787833841.495245:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406095488 00000100:00100000:2.0:1787833841.495266:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406095232 00000100:00100000:2.0:1787833841.495268:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406095232 00000100:00100000:2.0:1787833841.495280:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787833841.495286:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406095488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495315:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406095488:12345-0@lo:400:kworker.0 Request processed in 29us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495321:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787833841.495331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787833841.495336:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406095232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495371:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406095232:12345-0@lo:400:kworker.0 Request processed in 35us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495377:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787833841.495395:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406096000 00000100:00100000:2.0:1787833841.495398:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406096000 00000100:00100000:2.0:1787833841.495416:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406096512 00000100:00100000:2.0:1787833841.495419:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406096512 00000100:00100000:2.0:1787833841.495430:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406095872 00000100:00100000:2.0:1787833841.495432:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406095872 00000100:00100000:2.0:1787833841.495441:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406096384 00000100:00100000:2.0:1787833841.495443:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406096384 00000100:00100000:2.0:1787833841.495453:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787833841.495459:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406096000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495489:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406096000:12345-0@lo:400:kworker.0 Request processed in 30us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495494:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787833841.495505:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787833841.495510:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406096512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495536:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406096512:12345-0@lo:400:kworker.0 Request processed in 27us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495541:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787833841.495551:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787833841.495556:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406095872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495580:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406095872:12345-0@lo:400:kworker.0 Request processed in 25us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495585:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787833841.495595:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787833841.495607:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406096384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495634:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406096384:12345-0@lo:400:kworker.0 Request processed in 28us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.495639:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787833841.495672:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833841.495676:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833841.495679:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833841.495681:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833841.495715:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406095360:0@lo:400:kworker.0 00010000:00080000:2.0:1787833841.495729:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef70c0 x1874679406095872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833841.495773:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406095872:0@lo:400:kworker.0 00010000:00080000:2.0:1787833841.495785:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef7840 x1874679406096384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833841.495792:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406096384:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495800:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406095232:0@lo:400:kworker.0 00010000:00080000:2.0:1787833841.495808:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef4780 x1874679406095744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833841.495815:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406095744:0@lo:400:kworker.0 00010000:00080000:2.0:1787833841.495823:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef6940 x1874679406096256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833841.495830:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406096256:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495865:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406094976:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495882:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406095488:0@lo:400:kworker.0 00010000:00080000:2.0:1787833841.495890:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef4b40 x1874679406096000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833841.495898:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406096000:0@lo:400:kworker.0 00010000:00080000:2.0:1787833841.495907:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef4f00 x1874679406096512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833841.495914:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406096512:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495925:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406095104:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495935:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406095616:0@lo:400:kworker.0 00000100:00100000:2.0:1787833841.495943:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406096128:0@lo:400:kworker.0 00000100:00100000:3.0:1787833841.496626:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833841.496646:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406096640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833841.496695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833841.496728:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406096640 00000100:00100000:3.0:1787833841.496733:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406096640 00000100:00100000:3.0:1787833841.496793:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787833841.496800:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406096640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787833841.496826:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833841.496860:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406096640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833841.496867:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1787833841.497042:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fbb8b40 x1874679406096640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833841.497056:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406096640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833841.498865:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406096768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833841.498930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833841.499429:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406096768 00000100:00100000:2.0:1787833841.499437:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406096768 00000100:00100000:2.0:1787833841.499482:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787833841.499491:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406096768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833841.499529:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833841.504013:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406096768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4513us (5072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.504027:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1787833841.504453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a8ed00 x1874679406096768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833841.504476:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406096768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787833842.463592:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833842.517902:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406096896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787833842.517973:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833842.518055:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406096896 00000100:00100000:0.0:1787833842.518062:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406096896 00000100:00100000:0.0:1787833842.518107:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787833842.518116:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406096896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833842.518148:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787833842.518191:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406096896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833842.518198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787833842.518242:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406096896:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787833843.480790:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833844.061551:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406097024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833844.061615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833844.061687:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406097024 00000100:00100000:0.0:1787833844.061694:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406097024 00000100:00100000:0.0:1787833844.061786:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787833844.061795:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406097024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833844.061894:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833844.061942:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406097024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833844.061949:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787833844.061968:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833844.061997:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50399f0c0 x1874679406097024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833844.062014:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406097024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833844.067600:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406097152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833844.067668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833844.067774:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406097152 00000100:00100000:2.0:1787833844.067781:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406097152 00000100:00100000:2.0:1787833844.067900:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787833844.067916:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406097152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833844.067938:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833844.067983:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406097152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833844.067990:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1787833844.068028:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a8cf00 x1874679406097152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833844.068047:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406097152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787833844.068065:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787833844.501879:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833844.796052:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833844.796095:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833844.796172:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381900160 00000100:00100000:3.0:1787833844.796182:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381900160 00000100:00100000:3.0:1787833844.796240:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 311 00000100:00100000:3.0:1787833844.796250:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381900160:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833844.796319:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381900160:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 70us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833844.796338:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 311 00000100:00100000:0.0:1787833844.799134:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833844.810037:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833844.810076:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833844.810116:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381900928 00000100:00100000:1.0:1787833844.810126:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381900928 00000100:00100000:1.0:1787833844.810204:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:1.0:1787833844.810214:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381900928:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833844.810282:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381900928:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833844.810291:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:2.0:1787833844.812026:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381900416 00000100:00100000:2.0:1787833844.812038:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381900416 00000100:00100000:2.0:1787833844.812092:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381900672 00000100:00100000:2.0:1787833844.812096:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381900672 00000100:00100000:2.0:1787833844.812121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00100000:2.0:1787833844.812131:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381900416:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833844.812406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381900416:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 275us (16309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833844.812414:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00100000:2.0:1787833844.812431:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 160 00000100:00100000:2.0:1787833844.812439:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381900672:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833844.812465:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381900672:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 28us (13340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833844.812470:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 160 00000100:00080000:2.0:1787833844.812488:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833844.812493:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833844.816007:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833844.816068:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833844.816154:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381900288 00000100:00100000:1.0:1787833844.816163:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381900288 00000100:00100000:1.0:1787833844.816226:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381900544 00000100:00100000:1.0:1787833844.816229:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381900544 00000100:00100000:1.0:1787833844.816249:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 161 00000100:00100000:1.0:1787833844.816256:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381900288:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833844.816328:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381900288:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 72us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833844.816335:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 161 00000100:00100000:1.0:1787833844.816352:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 162 00000100:00100000:1.0:1787833844.816358:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381900544:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833844.816382:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381900544:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833844.816387:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 162 00000100:00080000:0.0:1787833844.816546:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833844.816669:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381900800 00000100:00100000:2.0:1787833844.816674:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381900800 00000100:00100000:2.0:1787833844.816733:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:2.0:1787833844.816741:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381900800:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833844.816804:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381900800:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 64us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833844.816811:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00080000:0.0:1787833844.817731:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787833845.526633:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833846.103911:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406097280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833846.103983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.104090:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406097280 00000100:00100000:3.0:1787833846.104098:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406097280 00000100:00100000:3.0:1787833846.104153:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787833846.104163:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406097280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787833846.104195:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833846.104240:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406097280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.104246:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787833846.105002:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406097280:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787833846.552486:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833846.614462:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406097536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833846.614524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833846.614808:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833846.614820:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406097408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833846.614853:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616145:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406097664:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616225:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406098176:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616271:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406098688:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616315:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787833846.616320:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406098048:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616350:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406098560:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616396:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406097920:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616430:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406098432:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616471:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406098944:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616488:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616501:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787833846.616505:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406097792:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616520:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616533:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406098304:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616550:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616560:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406098816:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616579:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.616601:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406097664 00000100:00100000:3.0:1787833846.616607:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406097664 00000100:00100000:3.0:1787833846.616655:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787833846.616665:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406097664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616726:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406097664:12345-0@lo:400:kworker.0 Request processed in 63us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.616734:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787833846.616792:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406098176 00000100:00100000:3.0:1787833846.616796:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406098176 00000100:00100000:3.0:1787833846.616825:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406098688 00000100:00100000:3.0:1787833846.616828:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406098688 00000100:00100000:3.0:1787833846.616841:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406098048 00000100:00100000:3.0:1787833846.616843:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406098048 00000100:00100000:3.0:1787833846.616852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406097792 00000100:00100000:3.0:1787833846.616861:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406097792 00000100:00100000:3.0:1787833846.616876:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406098304 00000100:00100000:3.0:1787833846.616879:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406098304 00000100:00100000:3.0:1787833846.616890:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406098816 00000100:00100000:3.0:1787833846.616892:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406098816 00000100:00100000:3.0:1787833846.616907:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787833846.616913:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406098176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.616949:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406098176:12345-0@lo:400:kworker.0 Request processed in 36us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.616957:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787833846.616972:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787833846.616979:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406098688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617006:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406098688:12345-0@lo:400:kworker.0 Request processed in 28us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.617011:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787833846.617023:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787833846.617028:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406098048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617054:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406098048:12345-0@lo:400:kworker.0 Request processed in 27us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.617060:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787833846.617070:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787833846.617077:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406097792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617107:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406097792:12345-0@lo:400:kworker.0 Request processed in 30us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.617113:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787833846.617123:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787833846.617130:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406098304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617162:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406098304:12345-0@lo:400:kworker.0 Request processed in 33us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.617167:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787833846.617178:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787833846.617183:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406098816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617206:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406098816:12345-0@lo:400:kworker.0 Request processed in 22us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.617212:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787833846.617234:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406097920 00000100:00100000:3.0:1787833846.617237:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406097920 00000100:00100000:3.0:1787833846.617261:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787833846.617267:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406097920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617297:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406097920:12345-0@lo:400:kworker.0 Request processed in 30us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.617303:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787833846.617318:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406098560 00000100:00100000:3.0:1787833846.617321:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406098560 00000100:00100000:3.0:1787833846.617345:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406098432 00000100:00100000:3.0:1787833846.617348:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406098432 00000100:00100000:3.0:1787833846.617359:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406098944 00000100:00100000:3.0:1787833846.617361:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406098944 00000100:00100000:3.0:1787833846.617373:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787833846.617379:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406098560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617408:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406098560:12345-0@lo:400:kworker.0 Request processed in 29us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.617413:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787833846.617424:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787833846.617436:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406098432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617464:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406098432:12345-0@lo:400:kworker.0 Request processed in 29us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.617469:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787833846.617480:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787833846.617486:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406098944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617512:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406098944:12345-0@lo:400:kworker.0 Request processed in 26us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.617518:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787833846.617539:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833846.617543:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833846.617546:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787833846.617548:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833846.617585:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406097792:0@lo:400:kworker.0 00010000:00080000:3.0:1787833846.617599:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba7840 x1874679406098304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833846.617609:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406098304:0@lo:400:kworker.0 00010000:00080000:3.0:1787833846.617618:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50250b840 x1874679406098816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833846.617626:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406098816:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617636:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406097920:0@lo:400:kworker.0 00010000:00080000:3.0:1787833846.617647:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba5e00 x1874679406098432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833846.617656:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406098432:0@lo:400:kworker.0 00010000:00080000:3.0:1787833846.617679:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502508f00 x1874679406098944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833846.617689:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406098944:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617862:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406098048:0@lo:400:kworker.0 00010000:00080000:3.0:1787833846.617873:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba70c0 x1874679406098560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833846.617882:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406098560:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617890:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406097664:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617900:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406098176:0@lo:400:kworker.0 00000100:00100000:3.0:1787833846.617909:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406098688:0@lo:400:kworker.0 00000100:00100000:0.0:1787833846.618167:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406097536 00000100:00100000:0.0:1787833846.618174:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406097536 00000100:00100000:0.0:1787833846.618222:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406097408 00000100:00100000:0.0:1787833846.618226:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406097408 00000100:00100000:0.0:1787833846.618241:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787833846.618250:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406097536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787833846.618276:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833846.618294:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787833846.618307:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406097408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833846.618321:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833846.618328:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406097536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (3802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833846.618346:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787833846.618364:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406097408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833846.618373:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1787833846.618386:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df602c21a40 x1874679406097536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833846.618405:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406097536:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787833846.618464:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787833846.618853:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fbba940 x1874679406097408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833846.618868:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406097408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787833847.573910:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833847.642313:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833847.642346:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406099072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787833847.642419:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833847.642611:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406099072 00000100:00100000:2.0:1787833847.642619:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406099072 00000100:00100000:2.0:1787833847.642674:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787833847.642684:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406099072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787833847.642727:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787833847.642797:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406099072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833847.642804:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787833847.642887:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406099072:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1787833847.955028:0:12502:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787833847.955337:0:12502:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787833848.598051:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833849.173905:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833849.173928:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406099200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833849.173993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833849.174322:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406099200 00000100:00100000:0.0:1787833849.174331:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406099200 00000100:00100000:0.0:1787833849.174395:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787833849.174405:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406099200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833849.174432:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833849.174478:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406099200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833849.174485:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1787833849.174532:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df602c23840 x1874679406099200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833849.174549:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406099200:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787833849.174613:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833849.181434:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833849.181459:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406099328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833849.181526:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833849.181656:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406099328 00000100:00100000:0.0:1787833849.181663:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406099328 00000100:00100000:0.0:1787833849.181734:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787833849.181744:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406099328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833849.181788:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833849.182378:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406099328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 633us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833849.182385:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787833849.182409:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787833849.182472:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df602c23840 x1874679406099328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833849.182491:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406099328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787833849.630221:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833849.917887:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833849.917938:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833849.917960:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833849.917984:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833849.918002:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833849.918019:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833849.918048:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833849.918076:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381901312 00000100:00100000:0.0:1787833849.918085:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381901312 00000100:00100000:0.0:1787833849.918137:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381901568 00000100:00100000:0.0:1787833849.918141:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381901568 00000100:00100000:0.0:1787833849.918155:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381901184 00000100:00100000:0.0:1787833849.918156:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381901184 00000100:00100000:0.0:1787833849.918167:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381901440 00000100:00100000:0.0:1787833849.918168:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381901440 00000100:00100000:0.0:1787833849.918182:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 169 00000100:00100000:0.0:1787833849.918192:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381901312:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833849.918352:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381901056 00000100:00100000:2.0:1787833849.918357:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381901056 00000100:00100000:2.0:1787833849.918383:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 313 00000100:00100000:2.0:1787833849.918392:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381901056:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833849.918446:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381901056:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 55us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833849.918454:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 313 00000100:00100000:3.0:1787833849.919840:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 170 00000100:00100000:3.0:1787833849.919856:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381901568:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833849.919930:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381901568:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 80us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833849.919938:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 170 00000100:00100000:3.0:1787833849.919961:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 171 00000100:00100000:3.0:1787833849.919981:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381901184:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833849.920013:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381901184:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 34us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833849.920019:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 171 00000100:00100000:3.0:1787833849.920032:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 172 00000100:00100000:3.0:1787833849.920038:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381901440:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833849.920063:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381901440:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833849.920070:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 172 00000100:00100000:3.0:1787833849.920094:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381901824 00000100:00100000:3.0:1787833849.920098:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381901824 00000100:00100000:3.0:1787833849.920136:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381901696 00000100:00100000:3.0:1787833849.920139:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381901696 00000100:00100000:3.0:1787833849.920161:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:3.0:1787833849.920168:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381901824:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833849.920195:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381901824:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 28us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833849.920201:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:3.0:1787833849.920214:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:3.0:1787833849.920220:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381901696:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833849.920243:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381901696:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833849.920262:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:0.0:1787833849.922342:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381901312:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 4140us (4391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833849.922356:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 169 00000100:00080000:0.0:1787833849.922399:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833849.922404:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833849.922407:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833849.922410:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:3.0:1787833850.254007:0:12599:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787833850.254286:0:12599:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787833850.646803:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833851.225843:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406099456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833851.225910:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833851.225994:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406099456 00000100:00100000:3.0:1787833851.226000:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406099456 00000100:00100000:3.0:1787833851.226043:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787833851.226051:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406099456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787833851.226083:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833851.226126:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406099456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.226133:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787833851.226176:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406099456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787833851.670118:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833851.734003:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406099584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833851.734073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833851.734146:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406099584 00000100:00100000:0.0:1787833851.734152:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406099584 00000100:00100000:0.0:1787833851.734203:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787833851.734212:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406099584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787833851.734256:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833851.734299:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406099584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833851.734307:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787833851.734327:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833851.734424:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406099712:0@lo:400:kworker.0 00000100:00100000:0.0:1787833851.734456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833851.734477:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406100224:0@lo:400:kworker.0 00000100:00100000:0.0:1787833851.734504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833851.734532:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406100736:0@lo:400:kworker.0 00000100:00100000:0.0:1787833851.734551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833851.734568:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787833851.734587:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406100096:0@lo:400:kworker.0 00000100:00100000:0.0:1787833851.734617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833851.734632:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406100608:0@lo:400:kworker.0 00000100:00100000:0.0:1787833851.734653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787833851.734703:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6212fe940 x1874679406099584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833851.734719:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406099584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833851.734909:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406099840:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.734939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833851.734958:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406100352:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.734978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833851.734987:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406100864:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833851.735016:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787833851.735021:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406099968:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735040:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833851.735055:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406100480:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735073:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833851.735086:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406100992:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833851.735145:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406099712 00000100:00100000:3.0:1787833851.735149:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406099712 00000100:00100000:3.0:1787833851.735184:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787833851.735205:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406099712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735252:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406099712:12345-0@lo:400:kworker.0 Request processed in 61us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787833851.735287:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406100224 00000100:00100000:3.0:1787833851.735291:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406100224 00000100:00100000:3.0:1787833851.735314:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406100736 00000100:00100000:3.0:1787833851.735317:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406100736 00000100:00100000:3.0:1787833851.735328:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406100096 00000100:00100000:3.0:1787833851.735330:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406100096 00000100:00100000:3.0:1787833851.735339:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406099840 00000100:00100000:3.0:1787833851.735341:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406099840 00000100:00100000:3.0:1787833851.735349:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406100352 00000100:00100000:3.0:1787833851.735350:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406100352 00000100:00100000:3.0:1787833851.735362:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406100864 00000100:00100000:3.0:1787833851.735363:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406100864 00000100:00100000:3.0:1787833851.735375:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787833851.735380:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406100224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735413:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406100224:12345-0@lo:400:kworker.0 Request processed in 32us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787833851.735431:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787833851.735437:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406100736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735467:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406100736:12345-0@lo:400:kworker.0 Request processed in 31us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735479:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787833851.735492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787833851.735497:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406100096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735525:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406100096:12345-0@lo:400:kworker.0 Request processed in 28us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735530:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787833851.735541:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787833851.735546:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406099840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735577:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406099840:12345-0@lo:400:kworker.0 Request processed in 29us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787833851.735594:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787833851.735599:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406100352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735626:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406100352:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735631:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787833851.735641:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787833851.735646:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406100864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735682:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406100864:12345-0@lo:400:kworker.0 Request processed in 35us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735687:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787833851.735713:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406100608 00000100:00100000:3.0:1787833851.735717:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406100608 00000100:00100000:3.0:1787833851.735739:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406100480 00000100:00100000:3.0:1787833851.735742:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406100480 00000100:00100000:3.0:1787833851.735789:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406100992 00000100:00100000:3.0:1787833851.735792:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406100992 00000100:00100000:3.0:1787833851.735804:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787833851.735809:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406100608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735838:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406100608:12345-0@lo:400:kworker.0 Request processed in 29us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735843:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787833851.735854:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787833851.735860:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406100480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735886:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406100480:12345-0@lo:400:kworker.0 Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735892:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787833851.735902:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787833851.735907:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406100992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.735932:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406100992:12345-0@lo:400:kworker.0 Request processed in 25us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.735938:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787833851.735961:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406099968 00000100:00100000:3.0:1787833851.735965:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406099968 00000100:00100000:3.0:1787833851.735990:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787833851.735996:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406099968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.736025:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406099968:12345-0@lo:400:kworker.0 Request processed in 29us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833851.736030:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787833851.736073:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406099968:0@lo:400:kworker.0 00010000:00080000:3.0:1787833851.736085:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df62133bc00 x1874679406100480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833851.736102:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406100480:0@lo:400:kworker.0 00010000:00080000:3.0:1787833851.736114:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6212912c0 x1874679406100992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833851.736122:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406100992:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.736131:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406099840:0@lo:400:kworker.0 00010000:00080000:3.0:1787833851.736139:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621339e00 x1874679406100352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787833851.736305:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833851.736310:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833851.736311:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833851.736313:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833851.736325:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406101120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833851.736358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833851.736393:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406101120 00000100:00100000:0.0:1787833851.736397:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406101120 00000100:00100000:0.0:1787833851.736422:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787833851.736428:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406101120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833851.736441:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833851.736473:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406101120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833851.736478:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1787833851.736505:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5046de1c0 x1874679406101120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833851.736519:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406101120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833851.737531:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406100352:0@lo:400:kworker.0 00010000:00080000:3.0:1787833851.737557:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621293c00 x1874679406100864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833851.737567:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406100864:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.737626:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406100096:0@lo:400:kworker.0 00010000:00080000:3.0:1787833851.737638:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df62133ad00 x1874679406100608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833851.737647:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406100608:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.737657:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406099712:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.737677:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406100224:0@lo:400:kworker.0 00000100:00100000:3.0:1787833851.737691:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406100736:0@lo:400:kworker.0 00000020:00000004:0.0:1787833852.434106:0:12697:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787833852.434399:0:12697:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787833852.694923:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833852.760373:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833852.760397:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406101248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787833852.760479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833852.760872:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406101248 00000100:00100000:2.0:1787833852.760881:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406101248 00000100:00100000:2.0:1787833852.760932:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787833852.760942:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406101248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787833852.760980:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787833852.761080:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406101248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833852.761088:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787833852.769901:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406101248:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787833853.720973:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833854.294321:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833854.294342:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406101376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833854.294402:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833854.294471:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406101376 00000100:00100000:1.0:1787833854.294477:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406101376 00000100:00100000:1.0:1787833854.294526:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787833854.294534:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406101376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833854.294558:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833854.294597:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406101376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833854.294604:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787833854.294621:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787833854.294658:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb952c0 x1874679406101376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833854.294684:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406101376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833854.295107:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406101504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833854.295140:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833854.295196:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406101504 00000100:00100000:1.0:1787833854.295201:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406101504 00000100:00100000:1.0:1787833854.295231:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787833854.295238:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406101504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833854.295249:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833854.295303:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406101504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833854.295309:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787833854.295323:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833854.304531:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb952c0 x1874679406101504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833854.304559:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406101504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787833854.744959:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787833854.986197:0:12794:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787833854.986501:0:12794:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787833855.030526:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833855.030566:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833855.030594:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833855.030617:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833855.030661:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833855.030843:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381901952 00000100:00100000:3.0:1787833855.030853:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381901952 00000100:00100000:0.0:1787833855.030891:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381902208 00000100:00100000:0.0:1787833855.030897:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381902208 00000100:00100000:3.0:1787833855.030907:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 315 00000100:00100000:3.0:1787833855.030917:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381901952:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833855.030936:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381902464 00000100:00100000:0.0:1787833855.030940:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381902464 00000100:00100000:0.0:1787833855.030955:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381902080 00000100:00100000:0.0:1787833855.030958:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381902080 00000100:00100000:0.0:1787833855.030970:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381902336 00000100:00100000:0.0:1787833855.030973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381902336 00000100:00100000:0.0:1787833855.030989:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 179 00000100:00100000:3.0:1787833855.030993:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381901952:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 76us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833855.031001:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381902208:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833855.031008:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 315 00000100:00100000:0.0:1787833855.031040:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381902208:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 42us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833855.031049:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 179 00000100:00100000:0.0:1787833855.031063:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 180 00000100:00100000:0.0:1787833855.031069:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381902464:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833855.031106:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381902464:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833855.031113:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 180 00000100:00100000:0.0:1787833855.031124:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 181 00000100:00100000:0.0:1787833855.031132:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381902080:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833855.031148:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 182 00000100:00100000:0.0:1787833855.031155:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381902080:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833855.031162:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381902336:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833855.031167:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 181 00000100:00080000:0.0:1787833855.031187:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833855.031191:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787833855.031202:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381902336:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 45us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833855.031209:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 182 00000100:00100000:0.0:1787833855.034974:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833855.035014:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833855.035726:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381902592 00000100:00100000:1.0:1787833855.035737:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381902592 00000100:00100000:1.0:1787833855.035814:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381902720 00000100:00100000:1.0:1787833855.035818:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381902720 00000100:00100000:1.0:1787833855.035843:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:1.0:1787833855.035853:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2397:x1874679381902592:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:1.0:1787833855.035880:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d40c 00000100:00080000:1.0:1787833855.035889:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8df63c483000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787833855.035929:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787833855.036072:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+2:2397:x1874679381902592:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 220us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833855.036080:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:1.0:1787833855.036096:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:1.0:1787833855.036103:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2397:x1874679381902720:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:1.0:1787833855.036114:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d413 00000100:00080000:1.0:1787833855.036124:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8df63c3b8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787833855.036146:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787833855.036210:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+2:2397:x1874679381902720:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 108us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833855.036216:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00080000:1.0:1787833855.036233:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833855.036237:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787833855.036248:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833855.037462:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833855.768831:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833856.341937:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833856.341959:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406101632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833856.342022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833856.342227:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406101632 00000100:00100000:3.0:1787833856.342234:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406101632 00000100:00100000:3.0:1787833856.342279:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787833856.342286:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406101632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787833856.342315:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833856.342355:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406101632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833856.342362:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787833856.342407:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406101632:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787833856.790938:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833856.855726:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406102016:0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.855826:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833856.855896:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406102528:0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.855921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833856.855942:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406103040:0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.855972:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833856.856000:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787833856.856006:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406101888:0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.856029:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833856.856047:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406102400:0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.856066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833856.856082:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406102912:0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.856117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833856.856146:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406101888 00000100:00100000:0.0:1787833856.856154:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406101888 00000100:00100000:0.0:1787833856.856191:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406102400 00000100:00100000:0.0:1787833856.856193:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406102400 00000100:00100000:1.0:1787833856.856717:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406102528 00000100:00100000:1.0:1787833856.856721:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406102528 00000100:00100000:1.0:1787833856.856769:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406103040 00000100:00100000:1.0:1787833856.856772:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406103040 00000100:00100000:1.0:1787833856.856794:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787833856.856802:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406102528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.856872:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406102528:12345-0@lo:400:kworker.0 Request processed in 58us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833856.856880:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787833856.856895:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787833856.856901:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406103040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.856927:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406103040:12345-0@lo:400:kworker.0 Request processed in 27us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833856.856933:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787833856.856951:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833856.856955:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787833856.856985:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6c000 x1874679406102528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833856.857018:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406102528:0@lo:400:kworker.0 00010000:00080000:1.0:1787833856.857034:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6359a21c0 x1874679406103040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833856.857042:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406103040:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.857277:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406102144:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.857308:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833856.857323:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406102656:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.857345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833856.857362:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406103168:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.857381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833856.857401:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787833856.857406:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406101760:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.857430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833856.857454:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406102272:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.857497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833856.857510:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406102784:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.857532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833856.857542:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406103296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833856.857564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833856.857591:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406103424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833856.857611:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833856.857654:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406102912 00000100:00100000:2.0:1787833856.857659:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406102912 00000100:00100000:2.0:1787833856.857689:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406102144 00000100:00100000:2.0:1787833856.857692:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406102144 00000100:00100000:2.0:1787833856.857704:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406102272 00000100:00100000:2.0:1787833856.857707:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406102272 00000100:00100000:2.0:1787833856.857717:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406102784 00000100:00100000:2.0:1787833856.857719:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406102784 00000100:00100000:2.0:1787833856.857732:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787833856.857738:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406101888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.857798:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406101888:12345-0@lo:400:kworker.0 Request processed in 60us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833856.857805:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787833856.857819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787833856.858002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406102912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.858035:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406102912:12345-0@lo:400:kworker.0 Request processed in 36us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833856.858041:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787833856.858055:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787833856.858060:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406102144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.858283:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406102144:12345-0@lo:400:kworker.0 Request processed in 222us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833856.858289:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787833856.858302:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787833856.858308:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406102272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.858334:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406102272:12345-0@lo:400:kworker.0 Request processed in 27us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833856.858339:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787833856.858349:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787833856.858355:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406102784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.858380:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406102784:12345-0@lo:400:kworker.0 Request processed in 25us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833856.858386:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787833856.858413:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406101760 00000100:00100000:2.0:1787833856.858418:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406101760 00000100:00100000:2.0:1787833856.858446:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787833856.858452:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406101760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833856.858596:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406102016 00000100:00100000:3.0:1787833856.858602:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406102016 00000100:00100000:3.0:1787833856.858652:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787833856.858659:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406102016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833856.858695:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406102016:12345-0@lo:400:kworker.0 Request processed in 37us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833856.858701:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787833856.858730:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406102656 00000100:00100000:3.0:1787833856.858733:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406102656 00000100:00100000:3.0:1787833856.858779:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406103168 00000100:00100000:3.0:1787833856.858783:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406103168 00000100:00100000:3.0:1787833856.858800:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787833856.858806:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406102656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833856.858838:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406102656:12345-0@lo:400:kworker.0 Request processed in 32us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833856.858844:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787833856.858855:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787833856.858875:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406103168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833856.858903:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406103168:12345-0@lo:400:kworker.0 Request processed in 42us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833856.858909:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787833856.860277:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406101888:0@lo:400:kworker.0 00010000:00080000:1.0:1787833856.860296:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6359a3c00 x1874679406102912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833856.860308:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406102912:0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.860320:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406102016:0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.861934:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787833856.861945:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406102400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.862023:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406102400:12345-0@lo:400:kworker.0 Request processed in 80us (5955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833856.862029:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787833856.862080:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406103296 00000100:00100000:0.0:1787833856.862087:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406103296 00000100:00100000:0.0:1787833856.862109:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406103424 00000100:00100000:0.0:1787833856.862111:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406103424 00000100:00100000:0.0:1787833856.862122:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787833856.862127:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406103296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787833856.862149:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833856.862183:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406103296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (4617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833856.862189:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787833856.862215:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787833856.862222:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406103424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833856.862231:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833856.862266:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406103424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (4653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833856.862272:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787833856.862290:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833856.862306:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833856.862310:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833856.862312:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833856.862341:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406101760:0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.862357:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406102272:0@lo:400:kworker.0 00000100:00100000:0.0:1787833856.862368:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406102784:0@lo:400:kworker.0 00010000:00080000:0.0:1787833856.862381:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb94780 x1874679406103296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833856.862397:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406103296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833856.862410:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406102144:0@lo:400:kworker.0 00010000:00080000:0.0:1787833856.862421:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6e940 x1874679406102656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833856.862429:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406102656:0@lo:400:kworker.0 00010000:00080000:0.0:1787833856.862440:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6359a0f00 x1874679406103168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833856.862448:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406103168:0@lo:400:kworker.0 00010000:00080000:1.0:1787833856.862678:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6c780 x1874679406102400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833856.862688:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406102400:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.863168:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406101760:12345-0@lo:400:kworker.0 Request processed in 4712us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833856.863177:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00080000:2.0:1787833856.863218:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef7480 x1874679406103424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833856.863232:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406103424:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1787833857.090055:0:12891:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787833857.090307:0:12891:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787833857.815821:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833857.879822:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833857.879849:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406103552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787833857.879923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833857.880004:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406103552 00000100:00100000:0.0:1787833857.880012:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406103552 00000100:00100000:0.0:1787833857.880063:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787833857.880072:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406103552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833857.880104:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787833857.880167:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406103552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833857.880174:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787833857.880217:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406103552:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787833858.845731:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833859.414179:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406103680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833859.414251:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833859.414624:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406103680 00000100:00100000:1.0:1787833859.414632:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406103680 00000100:00100000:1.0:1787833859.414695:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787833859.414705:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406103680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833859.414732:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833859.414812:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406103680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833859.414818:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787833859.415087:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406103808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833859.415121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787833859.415319:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833859.415332:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406103808 00000100:00100000:0.0:1787833859.415336:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406103808 00000100:00100000:0.0:1787833859.415380:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787833859.415388:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406103808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833859.415400:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833859.415431:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406103808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833859.415437:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1787833859.415473:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb952c0 x1874679406103680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833859.415491:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406103680:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787833859.416685:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833859.417842:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef7480 x1874679406103808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833859.417863:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406103808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787833859.866451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833860.154459:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833860.154650:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381902848 00000100:00100000:1.0:1787833860.154659:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381902848 00000100:00100000:1.0:1787833860.154723:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 317 00000100:00100000:1.0:1787833860.154733:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381902848:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833860.154816:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381902848:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 85us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833860.154823:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 317 00000100:00100000:1.0:1787833860.156822:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833860.156854:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833860.156876:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833860.156898:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833860.156922:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381902976 00000100:00100000:1.0:1787833860.156930:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381902976 00000100:00100000:1.0:1787833860.156978:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381903104 00000100:00100000:1.0:1787833860.156982:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381903104 00000100:00100000:1.0:1787833860.156995:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381903232 00000100:00100000:1.0:1787833860.156997:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381903232 00000100:00100000:1.0:1787833860.157008:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381903360 00000100:00100000:1.0:1787833860.157010:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381903360 00000100:00100000:1.0:1787833860.157026:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:1.0:1787833860.157034:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381902976:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833860.157096:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381902976:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 63us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833860.157103:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:1.0:1787833860.157120:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:1.0:1787833860.157127:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381903104:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833860.157150:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381903104:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833860.157162:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:1.0:1787833860.157174:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:1.0:1787833860.157181:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381903232:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833860.157206:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381903232:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833860.157212:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:1.0:1787833860.157222:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 192 00000100:00100000:1.0:1787833860.157228:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381903360:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833860.157249:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381903360:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 21us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833860.157254:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 192 00000100:00080000:1.0:1787833860.157277:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833860.157281:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787833860.885866:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787833860.904469:0:13037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1787833860.952104:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c5eda4b-a2af-428f-9382-408414ba28ec 00000020:00000080:3.0:1787833860.952113:0:9510:0:(genops.c:885:class_export_put()) final put ffff8df63c487800/4c5eda4b-a2af-428f-9382-408414ba28ec 00000020:00000080:3.0:1787833860.952138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c487800/4c5eda4b-a2af-428f-9382-408414ba28ec for lustre-OST0001 00000020:00000080:3.0:1787833860.952187:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df63c3b8000 for lustre-OST0001 00000001:00100000:1.0:1787833860.957662:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c5eda4b-a2af-428f-9382-408414ba28ec 00000020:00000080:1.0:1787833860.957672:0:8424:0:(genops.c:885:class_export_put()) final put ffff8df63c480000/4c5eda4b-a2af-428f-9382-408414ba28ec 00000020:00000080:3.0:1787833860.957739:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c480000/4c5eda4b-a2af-428f-9382-408414ba28ec for lustre-OST0000 00000020:00000080:3.0:1787833860.957809:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df63c483000 for lustre-OST0000 00000100:00100000:1.0:1787833861.461958:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833861.462572:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406103936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833861.462650:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833861.463012:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406103936 00000100:00100000:3.0:1787833861.463021:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406103936 00000100:00100000:3.0:1787833861.463079:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787833861.463089:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406103936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787833861.463125:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833861.463181:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406103936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833861.463189:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787833861.463229:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406103936:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787833861.912361:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833861.973886:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833861.973916:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406104064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833861.973982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833861.974046:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406104064 00000100:00100000:2.0:1787833861.974068:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406104064 00000100:00100000:2.0:1787833861.974122:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787833861.974132:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406104064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833861.974174:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833861.974214:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406104064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833861.974222:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787833861.974241:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787833861.974266:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef7480 x1874679406104064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833861.974283:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406104064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833861.975678:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833861.975691:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406104320:0@lo:400:kworker.0 00000100:00100000:2.0:1787833861.975738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833861.975797:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406104192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833861.975823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833861.975846:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406104832:0@lo:400:kworker.0 00000100:00100000:2.0:1787833861.975869:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833861.975885:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406105344:0@lo:400:kworker.0 00000100:00100000:2.0:1787833861.975901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833861.975917:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787833861.975922:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406104704:0@lo:400:kworker.0 00000100:00100000:2.0:1787833861.975952:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833861.975969:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406105216:0@lo:400:kworker.0 00000100:00100000:2.0:1787833861.975990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833861.976019:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406104192 00000100:00100000:2.0:1787833861.976025:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406104192 00000100:00100000:0.0:1787833861.976187:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406104576:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.976235:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406105088:0@lo:400:kworker.0 00000100:00100000:3.0:1787833861.976241:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406104320 00000100:00100000:3.0:1787833861.976245:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406104320 00000100:00100000:0.0:1787833861.976253:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.976270:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406105600:0@lo:400:kworker.0 00000100:00100000:3.0:1787833861.976273:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787833861.976280:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406104320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.976316:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787833861.976319:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406104320:12345-0@lo:400:kworker.0 Request processed in 40us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.976321:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406104448:0@lo:400:kworker.0 00000100:00100000:3.0:1787833861.976327:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787833861.976340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.976356:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406104960:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.976387:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406105472:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976406:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.976428:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406104576 00000100:00100000:0.0:1787833861.976431:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406104576 00000100:00100000:0.0:1787833861.976476:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787833861.976483:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406104576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976520:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406104576:12345-0@lo:400:kworker.0 Request processed in 38us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.976526:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787833861.976543:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406105216 00000100:00100000:0.0:1787833861.976546:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406105216 00000100:00100000:0.0:1787833861.976577:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406105088 00000100:00100000:0.0:1787833861.976580:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406105088 00000100:00100000:0.0:1787833861.976592:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406105600 00000100:00100000:0.0:1787833861.976594:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406105600 00000100:00100000:0.0:1787833861.976617:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787833861.976622:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406105216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976653:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406105216:12345-0@lo:400:kworker.0 Request processed in 31us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.976659:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787833861.976670:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787833861.976682:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406105088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976710:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406105088:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.976716:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787833861.976729:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787833861.976734:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3641:x1874679406105600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976779:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3641:x1874679406105600:12345-0@lo:400:kworker.0 Request processed in 44us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.976784:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787833861.976804:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406104832 00000100:00100000:0.0:1787833861.976808:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406104832 00000100:00100000:0.0:1787833861.976824:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406105344 00000100:00100000:0.0:1787833861.976827:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406105344 00000100:00100000:0.0:1787833861.976838:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406104704 00000100:00100000:0.0:1787833861.976840:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406104704 00000100:00100000:0.0:1787833861.976846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406104448 00000100:00100000:0.0:1787833861.976848:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406104448 00000100:00100000:0.0:1787833861.976856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406104960 00000100:00100000:0.0:1787833861.976858:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406104960 00000100:00100000:0.0:1787833861.976869:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406105472 00000100:00100000:0.0:1787833861.976871:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406105472 00000100:00100000:0.0:1787833861.976882:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787833861.976887:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406104832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976913:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406104832:12345-0@lo:400:kworker.0 Request processed in 26us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.976918:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787833861.976928:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787833861.976933:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406105344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.976965:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406105344:12345-0@lo:400:kworker.0 Request processed in 33us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.976971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787833861.976982:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787833861.976987:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406104704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.977010:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406104704:12345-0@lo:400:kworker.0 Request processed in 23us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.977014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787833861.977025:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787833861.977030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406104448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.977068:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406104448:12345-0@lo:400:kworker.0 Request processed in 37us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.977073:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787833861.977084:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787833861.977090:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406104960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.977116:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406104960:12345-0@lo:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.977122:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787833861.977133:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787833861.977138:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406105472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.977165:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406105472:12345-0@lo:400:kworker.0 Request processed in 27us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.977171:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787833861.977202:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406104448:0@lo:400:kworker.0 00010000:00080000:0.0:1787833861.977225:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621338f00 x1874679406104960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833861.977236:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406104960:0@lo:400:kworker.0 00010000:00080000:0.0:1787833861.977246:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df62133bc00 x1874679406105472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833861.977254:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406105472:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.977262:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406104576:0@lo:400:kworker.0 00010000:00080000:0.0:1787833861.977271:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df62133ad00 x1874679406105088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833861.977278:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406105088:0@lo:400:kworker.0 00010000:00080000:0.0:1787833861.977287:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6213383c0 x1874679406105600/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833861.977294:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406105600:0@lo:400:kworker.0 00000100:00080000:0.0:1787833861.977374:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833861.977378:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833861.977380:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833861.977382:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833861.977728:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787833861.977738:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406104192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787833861.977769:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833861.977805:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406104192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833861.977812:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787833861.977843:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406104704:0@lo:400:kworker.0 00010000:00080000:2.0:1787833861.977854:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621339680 x1874679406105216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833861.977863:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406105216:0@lo:400:kworker.0 00000100:00100000:2.0:1787833861.977873:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406104832:0@lo:400:kworker.0 00000100:00100000:2.0:1787833861.977884:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406105344:0@lo:400:kworker.0 00000100:00100000:2.0:1787833861.977892:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406104320:0@lo:400:kworker.0 00010000:00080000:2.0:1787833861.977900:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503ef7480 x1874679406104192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833861.977911:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406104192:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787833862.935243:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833862.997908:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833862.997932:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406105728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787833862.998018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833862.998929:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406105728 00000100:00100000:0.0:1787833862.998939:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406105728 00000100:00100000:0.0:1787833862.999009:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787833862.999019:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406105728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833862.999058:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787833862.999137:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406105728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833862.999408:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406105728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787833862.999531:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00010000:0.0:1787833863.958028:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833864.539092:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833864.539120:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406105856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787833864.539205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833864.539324:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406105856 00000100:00100000:1.0:1787833864.539332:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406105856 00000100:00100000:1.0:1787833864.539405:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787833864.539415:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406105856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833864.539470:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833864.539516:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406105856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833864.539524:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1787833864.539563:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6e580 x1874679406105856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833864.539595:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406105856:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787833864.539924:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833864.542047:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833864.542065:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406105984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833864.542126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833864.547254:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406105984 00000100:00100000:0.0:1787833864.547267:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406105984 00000100:00100000:0.0:1787833864.547540:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787833864.547551:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406105984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833864.547576:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833864.547674:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406105984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (5547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833864.547681:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1787833864.549848:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787833864.550000:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a44000 x1874679406105984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833864.550023:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406105984:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1787833864.969810:0:13184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9458fdc0 20000000:00000080:0.0:1787833864.969827:0:13184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df635b3e000 uarg=0000000000000000 20000000:01000000:0.0:1787833864.969872:0:13184:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787833864.969878:0:13184:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787833864.969883:0:13184:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787833864.971118:0:13185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787833864.972037:0:13184:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787833864.983038:0:13184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787833864.983573:0:13184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.983604:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea81 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.983613:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3b1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.983620:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3bf expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.983627:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3cd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.983650:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d3db expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.983658:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eac0 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.983665:0:13184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.983710:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eac0 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.983724:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eac0 expref: 12 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833864.983738:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106112:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833864.984927:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d3db expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.984940:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3db expref: 23 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833864.984952:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106240:0@lo:104: 00000100:00100000:0.0:1787833864.984997:0:13184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833864.985039:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d3cd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.985046:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3cd expref: 23 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833864.985064:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106368:0@lo:104: 00000100:00100000:0.0:1787833864.985088:0:13184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833864.985113:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d3bf expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.985121:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3bf expref: 23 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833864.985129:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106496:0@lo:104: 00000100:00100000:0.0:1787833864.985165:0:13184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833864.985191:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d3b1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.985199:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3b1 expref: 23 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833864.985207:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f95680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106624:0@lo:104: 00000100:00100000:0.0:1787833864.985239:0:13184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833864.985257:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea81 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.985267:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea81 expref: 12 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833864.985276:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106752:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833864.985310:0:13184:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5044609c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833864.985358:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406106240 00000100:00100000:0.0:1787833864.985364:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406106240 00000100:00100000:0.0:1787833864.985409:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406106368 00000100:00100000:0.0:1787833864.985412:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406106368 00000100:00100000:0.0:1787833864.985420:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406106496 00000100:00100000:0.0:1787833864.985435:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406106496 00000100:00100000:0.0:1787833864.985449:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406106624 00000100:00100000:0.0:1787833864.985451:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406106624 00000100:00100000:0.0:1787833864.985464:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787833864.985471:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:13184:x1874679406106240:12345-0@lo:104: 00010000:00010000:0.0:1787833864.985483:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833864.986513:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787833864.986536:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:13184:x1874679406106368:12345-0@lo:104: 00010000:00010000:3.0:1787833864.986550:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.987799:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787833864.987919:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833864.987932:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:13184:x1874679406106240:12345-0@lo:104: Request processed in 2457us (2931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833864.987942:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787833864.987978:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787833864.987988:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:13184:x1874679406106496:12345-0@lo:104: 00010000:00010000:0.0:1787833864.988002:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.988069:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787833864.988074:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:13184:x1874679406106496:12345-0@lo:104: Request processed in 91us (2908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833864.988080:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787833864.988093:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787833864.988100:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:13184:x1874679406106624:12345-0@lo:104: 00010000:00010000:0.0:1787833864.988108:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988516:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787833864.988524:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988532:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833864.988536:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988544:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833864.988551:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833864.988556:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787833864.988604:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988612:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833864.988635:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988642:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1d3cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988658:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833864.988660:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988673:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833864.988676:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988683:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833864.988690:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833864.988695:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787833864.988712:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988718:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833864.988733:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988739:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df503c3a200/0x996d2fb20dc1d3bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.988748:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833864.988774:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833864.988776:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833864.988785:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833864.988801:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406106880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833864.989066:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787833864.989075:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:13184:x1874679406106368:12345-0@lo:104: Request processed in 2542us (3984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833864.989083:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787833864.989117:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833864.989126:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406107008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833864.989594:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.989603:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833864.989607:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.989615:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833864.989621:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833864.989626:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787833864.989662:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.989669:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833864.989677:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.989683:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b247400/0x996d2fb20dc1d3db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.989694:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833864.989696:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833864.989697:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833864.989708:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833864.989718:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406107136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833864.990071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833864.990173:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406106880 00000100:00100000:2.0:1787833864.990180:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406106880 00010000:00010000:2.0:1787833864.990217:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3cd expref: 24 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833864.990256:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787833864.990264:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406106880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833864.990276:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833864.990281:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3cd expref: 24 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.990304:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3cd expref: 24 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.990330:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833864.990367:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406106880:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833864.990375:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787833864.990414:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406106880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833864.990956:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833864.991004:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106240:0@lo:104: 00010000:00010000:2.0:1787833864.991016:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4e800/0x996d2fb20dc1d3d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d3cd expref: 23 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833864.991029:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106368:0@lo:104: 00000100:00100000:2.0:1787833864.991038:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106496:0@lo:104: 00000100:00100000:3.0:1787833864.991658:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833864.991784:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406107008 00000100:00100000:2.0:1787833864.991790:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406107008 00000100:00100000:3.0:1787833864.991985:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833864.992057:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833864.992077:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381903488 00000100:00100000:3.0:1787833864.992081:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381903488 00010000:00010000:0.0:1787833864.992724:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833864.992735:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:13184:x1874679406106624:12345-0@lo:104: Request processed in 4633us (7493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833864.992746:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1787833864.992803:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833864.992918:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3bf expref: 23 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833864.992961:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381903616 00000100:00100000:2.0:1787833864.992966:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381903616 00010000:00010000:0.0:1787833864.992993:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.993002:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787833864.993006:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.993014:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833864.993020:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833864.993025:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787833864.993072:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.993078:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833864.993099:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.993105:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b246000/0x996d2fb20dc1d3b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d3b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.993129:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833864.993130:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833864.993132:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833864.993638:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406107264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787833864.993683:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833864.993783:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406107264 00000100:00100000:0.0:1787833864.993788:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406107264 00010000:00010000:3.0:1787833864.993976:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eac0 expref: 14 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833864.993999:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787833864.994008:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621339680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406107008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833864.994018:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833864.994023:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3bf expref: 24 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833864.994032:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3bf expref: 24 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833864.994047:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b600/0x996d2fb20dc1d3c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d3bf expref: 24 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833864.994070:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833864.994107:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621339680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3639:x1874679406107008:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833864.994114:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787833864.994129:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:3.0:1787833864.994571:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cc589ca-8d60-40bb-ae0e-5988c094f6be+14:2401:x1874679381903488:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833864.994594:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833864.994600:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eac0 expref: 14 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833864.994610:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eac0 expref: 14 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833864.994621:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833864.994671:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cc589ca-8d60-40bb-ae0e-5988c094f6be+14:2401:x1874679381903488:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 535us (2688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833864.994678:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:3.0:1787833864.994730:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406107008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833864.995646:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea81 expref: 13 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833864.995714:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:2.0:1787833864.995725:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381903616:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833864.995736:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833864.995740:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea81 expref: 13 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.995769:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea81 expref: 13 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.995783:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833864.995832:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381903616:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 111us (3774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833864.995839:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00010000:00010000:0.0:1787833864.996530:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3b1 expref: 22 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.996631:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1d3f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eac0 expref: 12 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833864.996645:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106112:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833864.996656:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f95680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106624:0@lo:104: 00010000:00010000:1.0:1787833864.996665:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1d3aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea81 expref: 11 pid: 6507 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833864.996672:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874679406106752:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833864.996713:0:13184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833864.996850:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787833864.996861:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:3640:x1874679406107264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833864.996875:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833864.996881:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3b1 expref: 22 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833864.996889:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3b1 expref: 22 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833864.996915:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1d3b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d3b1 expref: 22 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833864.996925:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833864.996978:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3640:x1874679406107264:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833864.996985:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787833864.997120:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406107264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787833864.997709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833865.007625:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406107136 00000100:00100000:3.0:1787833865.007641:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406107136 00010000:00010000:3.0:1787833865.007694:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3db expref: 21 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833865.009101:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787833865.009120:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e167c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3638:x1874679406107136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833865.009527:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833865.009538:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3db expref: 21 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009554:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d3db expref: 21 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009604:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b247e00/0x996d2fb20dc1d3e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d3db expref: 21 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009618:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009627:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009644:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009650:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009656:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009663:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009668:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833865.009672:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.009680:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833865.010043:0:13184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833865.010058:0:13184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.017637:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.017681:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b7c00/0x996d2fb20dc1d41a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833865.017706:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833865.017825:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e167c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3638:x1874679406107136:12345-0@lo:103:ldlm_bl.0 Request processed in 8709us (20113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833865.017836:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787833865.017936:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406107136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833865.273141:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833865.273180:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833865.273203:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833865.273229:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833865.273257:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381903744 00000100:00100000:2.0:1787833865.273265:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381903744 00000100:00100000:2.0:1787833865.273319:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381904000 00000100:00100000:2.0:1787833865.273322:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381904000 00000100:00100000:2.0:1787833865.273336:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381903872 00000100:00100000:2.0:1787833865.273339:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381903872 00000100:00100000:2.0:1787833865.273351:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381904128 00000100:00100000:2.0:1787833865.273354:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381904128 00000100:00100000:2.0:1787833865.273371:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 199 00000100:00100000:2.0:1787833865.273380:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381903744:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833865.273457:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381903744:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 78us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833865.273464:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 199 00000100:00100000:2.0:1787833865.273482:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 200 00000100:00100000:2.0:1787833865.273488:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381904000:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833865.273543:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381904000:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 54us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833865.273549:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 200 00000100:00100000:2.0:1787833865.273562:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 201 00000100:00100000:2.0:1787833865.273568:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381903872:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833865.273604:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381903872:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 35us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833865.273610:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 201 00000100:00100000:2.0:1787833865.273621:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 202 00000100:00100000:2.0:1787833865.273627:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381904128:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833865.273649:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381904128:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833865.273655:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 202 00000100:00080000:2.0:1787833865.273678:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833865.273681:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787833866.007720:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787833866.327153:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833866.327170:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63fb44000 from 7 10000000:01000000:3.0:1787833866.327175:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833866.327224:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833866.327236:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833866.327248:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833866.327278:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833866.327346:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833866.327405:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604e30780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833866.327604:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406107392 00000100:00100000:1.0:1787833866.327625:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406107392 00000100:00100000:1.0:1787833866.327681:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787833866.327691:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406107392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833866.327704:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833866.327717:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d421 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833866.327742:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d421 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833866.327789:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d421 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833866.327810:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3aa00, rc 0) 00000100:00100000:1.0:1787833866.327858:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406107392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833866.327866:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787833866.328212:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833866.328228:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.328238:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833866.328306:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833866.328337:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833866.328370:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340540 going to sleep for 11 seconds 00000100:00100000:3.0:1787833866.328665:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406107520 00000100:00100000:3.0:1787833866.328671:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406107520 00000100:00100000:3.0:1787833866.328712:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787833866.328719:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406107520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833866.328862:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406107520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833866.328870:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787833866.329064:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833866.329096:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833866.329136:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833866.329167:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833866.330304:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406107648 00000100:00100000:1.0:1787833866.330315:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406107648 00000100:00100000:1.0:1787833866.330357:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787833866.330366:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406107648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833866.330525:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406107648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833866.330539:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787833866.330808:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787833866.335130:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787833866.339117:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787833866.339296:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787833866.339311:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.339325:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833866.339337:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787833866.339341:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df6359b9000 from 7 10000000:01000000:0.0:1787833866.339344:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787833866.339383:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.339391:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.339401:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833866.339498:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833866.341540:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833866.342007:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833866.346675:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406107776 00000100:00100000:3.0:1787833866.346690:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406107776 00000100:00100000:3.0:1787833866.346831:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787833866.346843:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406107776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833866.346862:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833866.346883:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d42f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833866.346911:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d42f expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833866.346921:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d42f expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833866.346931:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246200, rc 0) 00000100:00100000:3.0:1787833866.347778:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406107776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 909us (8181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833866.347786:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787833866.348561:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833866.348593:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.348604:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833866.348706:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833866.348782:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833866.370598:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833866.373358:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406107904 00000100:00100000:1.0:1787833866.373373:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406107904 00000100:00100000:1.0:1787833866.375823:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787833866.375839:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406107904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833866.377189:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406107904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1350us (28401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833866.377200:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787833866.382381:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406107904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833866.382464:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833866.382545:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833866.382602:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833866.382785:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406108032 00000100:00100000:1.0:1787833866.382791:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406108032 00000100:00100000:1.0:1787833866.382843:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787833866.382853:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406108032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833866.382977:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406108032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833866.382984:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787833866.383399:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787833866.389257:0:13206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787833866.390786:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787833866.390817:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833866.390829:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833866.390849:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833866.390861:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833866.390864:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63b1db800 from 7 10000000:01000000:3.0:1787833866.390866:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833866.390900:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833866.390907:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833866.390916:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833866.390940:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833866.391006:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833866.391049:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604e30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833866.391340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406108160 00000100:00100000:0.0:1787833866.391347:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406108160 00000100:00100000:0.0:1787833866.391402:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787833866.391425:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406108160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833866.391438:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833866.391452:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d43d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.391475:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d43d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.391486:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d43d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.391495:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6200, rc 0) 00000100:00100000:0.0:1787833866.391546:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406108160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833866.391555:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787833866.391585:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833866.391603:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833866.391614:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833866.391666:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833866.391691:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833866.391725:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604e30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833866.393049:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406108288 00000100:00100000:0.0:1787833866.393065:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406108288 00000100:00100000:0.0:1787833866.393106:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787833866.393113:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406108288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833866.393303:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406108288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833866.393310:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787833866.393396:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833866.393452:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833866.393498:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833866.393527:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833866.393910:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406108416 00000100:00100000:0.0:1787833866.393915:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406108416 00000100:00100000:0.0:1787833866.393959:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787833866.393967:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406108416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833866.394052:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406108416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833866.394058:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787833866.394135:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787833866.396260:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787833866.398827:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787833866.398871:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787833866.398890:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.398908:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833866.398919:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787833866.398922:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df60efc3000 from 7 10000000:01000000:0.0:1787833866.398925:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787833866.398973:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.398981:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833866.398991:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833866.399020:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833866.399103:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833866.399153:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340600 going to sleep for 11 seconds 00000100:00100000:1.0:1787833866.400551:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406108544 00000100:00100000:1.0:1787833866.400812:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406108544 00000100:00100000:1.0:1787833866.400902:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787833866.400912:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406108544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833866.400932:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833866.400955:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d44b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833866.400989:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d44b expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833866.400999:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d44b expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833866.401008:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3bc00, rc 0) 00000100:00100000:1.0:1787833866.401087:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406108544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833866.401095:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787833866.401278:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833866.401302:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833866.401312:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833866.401408:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833866.401464:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833866.401502:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833866.404835:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406108672 00000100:00100000:1.0:1787833866.404850:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406108672 00000100:00100000:1.0:1787833866.404908:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787833866.404920:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406108672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833866.405080:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406108672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833866.405090:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787833866.408320:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833866.408379:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833866.408454:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833866.408497:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833866.409623:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406108800 00000100:00100000:1.0:1787833866.409633:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406108800 00000100:00100000:1.0:1787833866.409690:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787833866.409700:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406108800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833866.409863:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406108800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833866.409872:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787833866.410098:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046dcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406108800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787833866.411351:0:13209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787833866.411715:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787833866.411737:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787833866.411775:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833866.411787:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833866.585428:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406108928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833866.585503:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833866.586052:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406108928 00000100:00100000:2.0:1787833866.586061:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406108928 00000100:00100000:2.0:1787833866.586116:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787833866.586126:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406108928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833866.586159:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833866.607595:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406108928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 21460us (22080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833866.607611:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787833866.609110:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406108928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833866.871912:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833866.872170:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381904256 00000100:00100000:2.0:1787833866.872186:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381904256 00000100:00100000:2.0:1787833866.872254:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 331 00000100:00100000:2.0:1787833866.872265:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:6175:x1874679381904256:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833866.872282:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833866.872298:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eaf1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833866.872324:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf1 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833866.872336:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf1 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833866.872344:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:2.0:1787833866.872402:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381904256:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 139us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833866.872409:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 331 00000100:00100000:3.0:1787833866.879487:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833866.879676:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381904384 00000100:00100000:1.0:1787833866.879685:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381904384 00000100:00100000:3.0:1787833866.879941:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 332 00000100:00100000:3.0:1787833866.879953:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381904384:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833866.880100:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381904384:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 150us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833866.880118:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 332 00000100:00100000:3.0:1787833866.883791:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833866.883935:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381904512 00000100:00100000:0.0:1787833866.883944:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381904512 00000100:00100000:0.0:1787833866.883988:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 333 00000100:00100000:0.0:1787833866.883997:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381904512:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833866.884145:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381904512:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 148us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833866.884154:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 333 00000100:00100000:0.0:1787833866.911307:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833866.914044:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381904640 00000100:00100000:1.0:1787833866.914060:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381904640 00000100:00100000:1.0:1787833866.914128:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 334 00000100:00100000:1.0:1787833866.914140:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381904640:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833866.914158:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833866.914177:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eaf8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833866.914211:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf8 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833866.914223:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf8 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833866.914233:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a000, rc 0) 00000100:00100000:1.0:1787833866.914314:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381904640:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 176us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833866.914322:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 334 00000100:00100000:1.0:1787833866.928080:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833866.928273:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381904768 00000100:00100000:3.0:1787833866.928282:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381904768 00000100:00100000:3.0:1787833866.928364:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 335 00000100:00100000:3.0:1787833866.928374:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381904768:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833866.928531:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381904768:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 149us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833866.928540:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 335 00000100:00100000:3.0:1787833866.937053:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833866.937145:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381904896 00000100:00100000:1.0:1787833866.937155:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381904896 00000100:00100000:1.0:1787833866.937298:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 336 00000100:00100000:1.0:1787833866.937310:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381904896:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833866.937465:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381904896:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 157us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833866.937481:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 336 00010000:00010000:1.0:1787833867.030031:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833867.095138:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406109056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833867.095205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833867.095339:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406109056 00000100:00100000:2.0:1787833867.095346:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406109056 00000100:00100000:2.0:1787833867.095398:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787833867.095483:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406109056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833867.095513:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833867.095570:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406109056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833867.095578:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787833867.095609:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787833867.095639:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec70c0 x1874679406109056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833867.095657:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406109056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833867.095788:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833867.095798:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406109184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833867.095826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833867.095859:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406109184 00000100:00100000:1.0:1787833867.095862:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406109184 00000100:00100000:1.0:1787833867.095893:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787833867.095899:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406109184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833867.095910:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833867.095940:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406109184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833867.095947:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1787833867.095960:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787833867.095975:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6c000 x1874679406109184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833867.095988:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406109184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833867.096653:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406109568:0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.096692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833867.096714:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406110080:0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.096777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833867.096795:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406110592:0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.096815:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833867.096836:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787833867.096841:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406109696:0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.096861:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833867.096877:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406110208:0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.096899:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833867.096929:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406109568 00000100:00100000:1.0:1787833867.096934:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406109568 00000100:00100000:1.0:1787833867.096969:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787833867.096978:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406109568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.097025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406109568:12345-0@lo:400:kworker.0 Request processed in 49us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833867.097033:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787833867.097052:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406110080 00000100:00100000:1.0:1787833867.097056:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406110080 00000100:00100000:1.0:1787833867.097086:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406110592 00000100:00100000:1.0:1787833867.097089:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406110592 00000100:00100000:1.0:1787833867.097103:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406109696 00000100:00100000:1.0:1787833867.097105:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406109696 00000100:00100000:1.0:1787833867.097118:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787833867.097123:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406110080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.097153:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406110080:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833867.097160:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787833867.097172:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787833867.097188:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406110592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.097218:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406110592:12345-0@lo:400:kworker.0 Request processed in 33us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833867.097224:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787833867.097236:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787833867.097255:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406109696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.097283:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406109696:12345-0@lo:400:kworker.0 Request processed in 41us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833867.097288:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787833867.097313:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406110208 00000100:00100000:1.0:1787833867.097318:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406110208 00000100:00100000:1.0:1787833867.097344:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787833867.097351:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406110208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.097382:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406110208:12345-0@lo:400:kworker.0 Request processed in 32us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833867.097389:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787833867.098570:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406109440:0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.098628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833867.098660:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406109952:0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.098683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833867.098713:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406110464:0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.098733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833867.098774:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787833867.098781:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406109312:0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.098809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833867.098835:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406109824:0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.098859:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833867.098874:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406110336:0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.098893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833867.098922:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406109312 00000100:00100000:2.0:1787833867.098928:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406109312 00000100:00100000:2.0:1787833867.098964:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787833867.098971:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406109312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.099016:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406109312:12345-0@lo:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833867.099023:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787833867.099059:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406110336 00000100:00100000:2.0:1787833867.099071:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406110336 00000100:00100000:2.0:1787833867.099105:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787833867.099112:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406110336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.099144:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406110336:12345-0@lo:400:kworker.0 Request processed in 33us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833867.099150:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787833867.099173:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406109440 00000100:00100000:2.0:1787833867.099176:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406109440 00000100:00100000:2.0:1787833867.099197:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406109952 00000100:00100000:2.0:1787833867.099200:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406109952 00000100:00100000:2.0:1787833867.099213:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406110464 00000100:00100000:2.0:1787833867.099216:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406110464 00000100:00100000:2.0:1787833867.099229:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787833867.099234:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406109440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.099263:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406109440:12345-0@lo:400:kworker.0 Request processed in 29us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833867.099269:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787833867.099281:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787833867.099286:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406109952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.099313:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406109952:12345-0@lo:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833867.099318:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787833867.099330:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787833867.099335:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406110464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.099363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406110464:12345-0@lo:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833867.099368:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787833867.100395:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406109312:0@lo:400:kworker.0 00010000:00080000:2.0:1787833867.100433:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba21c0 x1874679406110336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833867.100445:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406110336:0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.100458:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406109440:0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.100468:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406109952:0@lo:400:kworker.0 00000100:00100000:2.0:1787833867.100478:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406110464:0@lo:400:kworker.0 00000100:00080000:1.0:1787833867.102644:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833867.102653:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833867.102657:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787833867.102709:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406109696:0@lo:400:kworker.0 00010000:00080000:1.0:1787833867.102727:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba2580 x1874679406110208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833867.102737:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406110208:0@lo:400:kworker.0 00000100:00100000:1.0:1787833867.102762:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406109568:0@lo:400:kworker.0 00010000:00080000:1.0:1787833867.102776:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba3480 x1874679406110080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833867.102793:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406110080:0@lo:400:kworker.0 00010000:00080000:1.0:1787833867.102807:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba1680 x1874679406110592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833867.102814:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406110592:0@lo:400:kworker.0 00000100:00100000:0.0:1787833867.102961:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406109824 00000100:00100000:0.0:1787833867.102968:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406109824 00000100:00100000:0.0:1787833867.103027:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787833867.103036:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406109824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833867.103125:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406109824:12345-0@lo:400:kworker.0 Request processed in 91us (4265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833867.103132:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787833867.103165:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406109824:0@lo:400:kworker.0 00010000:00010000:1.0:1787833868.058290:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833868.118022:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833868.118046:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406110720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787833868.118114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833868.122265:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406110720 00000100:00100000:0.0:1787833868.122279:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406110720 00000100:00100000:0.0:1787833868.122350:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787833868.122361:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406110720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833868.122397:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787833868.122496:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406110720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833868.122503:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787833868.122578:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406110720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787833869.078312:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833869.655635:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406110848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833869.655733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833869.655874:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406110848 00000100:00100000:0.0:1787833869.655885:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406110848 00000100:00100000:0.0:1787833869.655978:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787833869.655990:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406110848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833869.656038:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833869.656118:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406110848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833869.656126:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787833869.656152:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833869.656191:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f94f00 x1874679406110848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833869.656212:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406110848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833869.663724:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406110976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833869.663853:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833869.664647:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406110976 00000100:00100000:3.0:1787833869.664660:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406110976 00000100:00100000:3.0:1787833869.664765:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787833869.664778:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406110976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833869.664813:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833869.664883:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406110976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833869.664912:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787833869.665602:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833869.665652:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621339680 x1874679406110976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833869.665678:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406110976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787833870.106837:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833870.391428:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833870.391483:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833870.391692:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833870.391723:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833870.391800:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833870.391841:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381905024 00000100:00100000:1.0:1787833870.391853:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381905024 00000100:00100000:1.0:1787833870.391920:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 338 00000100:00100000:1.0:1787833870.391932:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381905024:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833870.392132:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381905024:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 201us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833870.392141:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 338 00000100:00100000:1.0:1787833870.392252:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381905152 00000100:00100000:1.0:1787833870.392257:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381905152 00000100:00100000:0.0:1787833870.392265:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381905408 00000100:00100000:0.0:1787833870.392273:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381905408 00000100:00100000:1.0:1787833870.392302:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381905280 00000100:00100000:1.0:1787833870.392307:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381905280 00000100:00100000:0.0:1787833870.392311:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381905536 00000100:00100000:0.0:1787833870.392316:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381905536 00000100:00100000:1.0:1787833870.392336:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:1.0:1787833870.392345:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381905152:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833870.392364:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:1.0:1787833870.392385:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381905152:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 40us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833870.392392:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381905408:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833870.392408:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:1.0:1787833870.392426:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 211 00000100:00100000:1.0:1787833870.392434:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381905280:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833870.392439:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381905408:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 50us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833870.392448:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:0.0:1787833870.392469:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 212 00000100:00100000:1.0:1787833870.392475:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381905280:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 39us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833870.392484:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381905536:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833870.392490:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 211 00000100:00100000:0.0:1787833870.392519:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381905536:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 39us (766us total) trans 0 rc 0/0 00000100:00080000:1.0:1787833870.392702:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833870.392708:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833870.395096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 212 00000001:02000400:0.0:1787833870.738353:0:13384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787833871.127030:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833871.705997:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833871.706242:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406111104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787833871.710145:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833871.710258:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406111104 00000100:00100000:0.0:1787833871.710271:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406111104 00000100:00100000:0.0:1787833871.710343:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787833871.710356:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406111104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787833871.710421:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787833871.710732:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406111104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 377us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833871.710742:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787833871.710837:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406111104:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787833872.152040:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833872.214142:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406111232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833872.214255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833872.214361:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406111232 00000100:00100000:1.0:1787833872.214371:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406111232 00000100:00100000:1.0:1787833872.214462:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787833872.214473:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406111232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833872.214515:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833872.214580:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406111232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833872.214588:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1787833872.214615:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787833872.214649:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba2d00 x1874679406111232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833872.214670:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406111232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833872.215521:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406111488:0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.215587:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833872.215619:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406112000:0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.215643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833872.215672:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406112512:0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.215695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833872.215738:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787833872.215744:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406111360:0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.215804:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833872.215828:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406111872:0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.215854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833872.215871:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406112384:0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.215894:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833872.215926:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406111360 00000100:00100000:0.0:1787833872.215934:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406111360 00000100:00100000:0.0:1787833872.215978:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787833872.215986:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406111360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.216037:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406111360:12345-0@lo:400:kworker.0 Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833872.216044:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787833872.216256:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406111360:0@lo:400:kworker.0 00000100:00100000:3.0:1787833872.218917:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406111488 00000100:00100000:3.0:1787833872.218936:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406111488 00000100:00100000:1.0:1787833872.218987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406112000 00000100:00100000:1.0:1787833872.218991:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406112000 00000100:00100000:3.0:1787833872.218994:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406112512 00000100:00100000:3.0:1787833872.218997:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406112512 00000100:00100000:3.0:1787833872.219032:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787833872.219121:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787833872.223561:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787833872.223584:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787833872.223632:0:9772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787833872.223648:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787833872.223663:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406112000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.223814:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406112000:12345-0@lo:400:kworker.0 Request processed in 155us (8169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833872.223822:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787833872.223857:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406111872 00000100:00100000:1.0:1787833872.223867:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406111872 00000100:00100000:1.0:1787833872.223902:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787833872.223909:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406111872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.225212:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406111872:12345-0@lo:400:kworker.0 Request processed in 1295us (9348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833872.225551:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406111488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.226113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787833872.226182:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406112384 00000100:00100000:1.0:1787833872.226192:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406112384 00000100:00100000:1.0:1787833872.226459:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787833872.226471:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406112384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.226578:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406112384:12345-0@lo:400:kworker.0 Request processed in 110us (10683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833872.226586:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787833872.226638:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406112896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833872.226717:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833872.227590:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406111616:0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.227652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833872.227689:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406112128:0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.227736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833872.227785:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406112640:0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.227809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833872.227827:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787833872.227834:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406111744:0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.227858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833872.227871:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406112256:0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.227898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833872.227914:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406112512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.227949:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406112896 00000100:00100000:0.0:1787833872.227959:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406112896 00000100:00100000:0.0:1787833872.228017:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787833872.228026:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406112896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833872.228056:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833872.228897:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406112768:0@lo:400:kworker.0 00000100:00100000:2.0:1787833872.230358:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406112256 00000100:00100000:2.0:1787833872.230563:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406112256 00000100:00100000:2.0:1787833872.230642:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787833872.230655:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406112256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.233096:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406112896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5045us (6354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833872.233116:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787833872.233260:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406111872:0@lo:400:kworker.0 00010000:00080000:0.0:1787833872.233283:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0da40 x1874679406112384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833872.233295:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406112384:0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.233312:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406112000:0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.233625:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406112512:12345-0@lo:400:kworker.0 Request processed in 14495us (17927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833872.233636:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787833872.233678:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406112512:0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.233699:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406112128 00000100:00100000:0.0:1787833872.233705:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406112128 00000100:00100000:0.0:1787833872.233748:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406112640 00000100:00100000:0.0:1787833872.233775:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406112640 00000100:00100000:0.0:1787833872.233793:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406111744 00000100:00100000:0.0:1787833872.233795:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406111744 00000100:00100000:0.0:1787833872.233813:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787833872.233822:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406112128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.233865:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406112128:12345-0@lo:400:kworker.0 Request processed in 44us (6128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833872.233872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787833872.233885:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787833872.233891:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406112640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.233923:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406112640:12345-0@lo:400:kworker.0 Request processed in 33us (6113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833872.233930:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787833872.233954:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787833872.233961:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406111744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833872.234011:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406111744:12345-0@lo:400:kworker.0 Request processed in 50us (6152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833872.234017:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00010000:00080000:0.0:1787833872.235956:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb861c0 x1874679406112896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833872.235988:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406112896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833872.236500:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406111488:12345-0@lo:400:kworker.0 Request processed in 17455us (20907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833872.236513:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787833872.236692:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406111488:0@lo:400:kworker.0 00000100:00100000:3.0:1787833872.237172:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406111616 00000100:00100000:3.0:1787833872.237183:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406111616 00000100:00100000:3.0:1787833872.237242:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787833872.237252:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406111616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833872.237352:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406111616:12345-0@lo:400:kworker.0 Request processed in 102us (9699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833872.237358:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1787833872.237380:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787833872.237387:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833872.237390:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833872.237393:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833872.238840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833872.238885:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406112768 00000100:00100000:1.0:1787833872.238895:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406112768 00000100:00100000:1.0:1787833872.239590:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787833872.239618:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406112768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.239704:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406112768:12345-0@lo:400:kworker.0 Request processed in 92us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833872.239712:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787833872.247646:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406112256:12345-0@lo:400:kworker.0 Request processed in 16980us (19732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833872.247664:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1787833872.247872:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb87480 x1874679406112768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833872.247894:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406112768:0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.247916:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406111616:0@lo:400:kworker.0 00010000:00080000:1.0:1787833872.247929:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0fc00 x1874679406112128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833872.247937:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406112128:0@lo:400:kworker.0 00010000:00080000:1.0:1787833872.247973:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0de00 x1874679406112640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833872.247983:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406112640:0@lo:400:kworker.0 00000100:00100000:1.0:1787833872.248372:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406111744:0@lo:400:kworker.0 00010000:00080000:1.0:1787833872.248386:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0d680 x1874679406112256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833872.248395:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406112256:0@lo:400:kworker.0 00010000:00010000:1.0:1787833873.174063:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833873.240541:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406113024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787833873.240614:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833873.240646:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406113024 00000100:00100000:1.0:1787833873.240653:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406113024 00000100:00100000:1.0:1787833873.240699:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787833873.240708:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406113024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787833873.240771:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787833873.240828:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406113024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833873.240836:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787833873.240944:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406113024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787833874.201346:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833874.773935:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833874.773960:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406113152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833874.774032:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833874.774102:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406113152 00000100:00100000:0.0:1787833874.774110:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406113152 00000100:00100000:0.0:1787833874.774166:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787833874.774176:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406113152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833874.774205:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833874.774258:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406113152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833874.774266:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1787833874.774282:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb84b40 x1874679406113152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833874.774298:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406113152:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787833874.774543:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833874.774576:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406113280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833874.774613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833874.775628:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406113280 00000100:00100000:0.0:1787833874.775637:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406113280 00000100:00100000:0.0:1787833874.775694:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787833874.775702:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406113280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833874.775720:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833874.775795:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406113280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1180us total) trans 0 rc 0/0 00000100:00080000:2.0:1787833874.775800:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833874.775815:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1787833874.775862:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6213383c0 x1874679406113280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833874.775879:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406113280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787833875.222105:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833875.511892:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833875.511942:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833875.511976:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833875.512025:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833875.512054:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833875.512090:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381905920 00000100:00100000:1.0:1787833875.512099:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381905920 00000100:00100000:3.0:1787833875.512240:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381906176 00000100:00100000:3.0:1787833875.512245:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381906176 00000100:00100000:3.0:1787833875.512273:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381905792 00000100:00100000:3.0:1787833875.512277:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381905792 00000100:00100000:0.0:1787833875.512282:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381906048 00000100:00100000:0.0:1787833875.512289:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381906048 00000100:00100000:3.0:1787833875.512298:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 219 00000100:00100000:3.0:1787833875.512311:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381905920:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833875.512321:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 220 00000100:00100000:0.0:1787833875.512332:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381906176:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833875.512385:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 221 00000100:00100000:3.0:1787833875.512391:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381905920:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 83us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833875.512399:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381905792:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833875.512403:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 219 00000100:00100000:3.0:1787833875.512424:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 222 00000100:00100000:3.0:1787833875.512433:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381906048:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833875.512478:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381905664 00000100:00100000:2.0:1787833875.512483:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381905664 00000100:00100000:2.0:1787833875.512527:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 340 00000100:00100000:2.0:1787833875.512536:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381905664:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833875.515661:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381906176:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 3320us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833875.515678:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 220 00000100:00080000:0.0:1787833875.516079:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833875.516086:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787833875.517241:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381905792:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 4836us (5204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833875.517265:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 221 00000100:00100000:3.0:1787833875.522257:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381906048:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 9812us (10189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833875.522273:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 222 00000100:00100000:2.0:1787833875.522526:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381905664:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 9988us (10641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833875.522536:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 340 00010000:00010000:1.0:1787833876.248332:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787833876.595573:0:13534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:31:15 (1787833875) === 00000100:00100000:2.0:1787833876.822193:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833876.822219:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406113408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787833876.822290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833876.822382:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406113408 00000100:00100000:1.0:1787833876.822390:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406113408 00000100:00100000:1.0:1787833876.822445:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787833876.822455:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406113408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787833876.822488:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787833876.822544:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406113408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833876.822551:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787833876.822595:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406113408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787833876.833425:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833876.833462:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833876.833488:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381906304 00000100:00100000:2.0:1787833876.833507:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381906304 00000100:00100000:2.0:1787833876.833613:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:2.0:1787833876.833623:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381906304:12345-192.168.203.17@tcp:41:mkdir.0 00000004:00000024:2.0:1787833876.833660:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787833876.833807:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381906304:12345-192.168.203.17@tcp:41:mkdir.0 Request processed in 184us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833876.833814:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:2.0:1787833876.833838:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381906432 00000100:00100000:2.0:1787833876.833841:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381906432 00000100:00100000:2.0:1787833876.834108:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:2.0:1787833876.834116:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:10493:x1874679381906432:12345-192.168.203.17@tcp:700:mkdir.0 00000100:00100000:2.0:1787833876.834151:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:10493:x1874679381906432:12345-192.168.203.17@tcp:700:mkdir.0 Request processed in 36us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833876.834158:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:2.0:1787833876.839573:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833876.839684:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381906688 00000100:00100000:0.0:1787833876.839696:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381906688 00000100:00100000:0.0:1787833876.839786:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:0.0:1787833876.839797:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:10493:x1874679381906688:12345-192.168.203.17@tcp:36:mkdir.0 00010000:00010000:0.0:1787833876.839850:0:9772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833876.839997:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d309 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea6c expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.840016:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df62150b100) 00010000:00010000:0.0:1787833876.840025:0:9772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833876.840199:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.840225:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.840236:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.840267:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.840276:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.840283:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.840999:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841012:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841020:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833876.841035:0:9772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1a7f65a reply state 000000001cf4574a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841046:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841468:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df503f02b00) 00010000:00010000:0.0:1787833876.841478:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787833876.841483:0:9772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787833876.841489:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787833876.841508:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841515:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841522:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841528:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833876.841532:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841540:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841551:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f02d00) 00010000:00010000:0.0:1787833876.841553:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833876.841557:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841563:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d467 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833876.841578:0:9772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1a7f65a reply state 000000001cf4574a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841586:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.841602:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df503f02800) 00010000:00010000:0.0:1787833876.841604:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787833876.841606:0:9772:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787833876.841700:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:10493:x1874679381906688:12345-192.168.203.17@tcp:36:mkdir.0 Request processed in 1902us (2129us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787833876.841708:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:2.0:1787833876.859736:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833876.859867:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381906816 00000100:00100000:3.0:1787833876.859876:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381906816 00000100:00100000:3.0:1787833876.859935:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787833876.859945:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:10494:x1874679381906816:12345-192.168.203.17@tcp:101:chmod.0 00010000:00010000:3.0:1787833876.859966:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833876.859990:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d47c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eaff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.860051:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d483 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.860083:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.860116:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833876.860164:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787833876.860168:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787833876.860205:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.860231:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d47c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaff expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.860249:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaff expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.860257:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df610177000) 00010000:00010000:3.0:1787833876.860261:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833876.860264:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247e00, rc 0) 00000100:00100000:3.0:1787833876.861257:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:10494:x1874679381906816:12345-192.168.203.17@tcp:101:chmod.0 Request processed in 396us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833876.861272:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787833876.870224:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833876.870368:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381907072 00000100:00100000:2.0:1787833876.870379:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381907072 00000100:00100000:2.0:1787833876.870440:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:2.0:1787833876.870450:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+8:10494:x1874679381907072:12345-192.168.203.17@tcp:36:chmod.0 00010000:00010000:2.0:1787833876.870510:0:13407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833876.870536:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d483 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaff expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.870555:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df610177000) 00010000:00010000:2.0:1787833876.870566:0:13407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833876.870596:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.870608:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.870618:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833876.871088:0:13407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f375c51e reply state 00000000f7ff1cf3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.871114:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.871121:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df62150bd00) 00010000:00010000:2.0:1787833876.871123:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787833876.871126:0:13407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787833876.871134:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787833876.871211:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+9:10494:x1874679381907072:12345-192.168.203.17@tcp:36:chmod.0 Request processed in 762us (996us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787833876.871219:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:1.0:1787833876.891297:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833876.891510:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381907200 00000100:00100000:0.0:1787833876.891521:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381907200 00000100:00100000:0.0:1787833876.891587:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:0.0:1787833876.891598:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+9:10495:x1874679381907200:12345-192.168.203.17@tcp:101:chown.0 00010000:00010000:0.0:1787833876.891621:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833876.891642:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6000/0x996d2fb20dc1d491 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb06 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.891705:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6e00/0x996d2fb20dc1d498 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.891721:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6e00/0x996d2fb20dc1d498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.891733:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6e00/0x996d2fb20dc1d498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833876.891813:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787833876.891817:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833876.891856:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6e00/0x996d2fb20dc1d498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.891882:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6000/0x996d2fb20dc1d491 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb06 expref: 11 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.891916:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6e00/0x996d2fb20dc1d498 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb06 expref: 10 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.891924:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df62150bd00) 00010000:00010000:0.0:1787833876.891927:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833876.891930:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6e00, rc 0) 00000100:00100000:0.0:1787833876.892149:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+10:10495:x1874679381907200:12345-192.168.203.17@tcp:101:chown.0 Request processed in 551us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833876.892157:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:0.0:1787833876.895390:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833876.895595:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381907328 00000100:00100000:2.0:1787833876.895605:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381907328 00000100:00100000:2.0:1787833876.895657:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1787833876.895666:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+10:10495:x1874679381907328:12345-192.168.203.17@tcp:101:chown.0 00010000:00010000:2.0:1787833876.895685:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833876.895704:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d49f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb0d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.895800:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.895814:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.895825:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.895835:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.895857:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.895864:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.895934:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d4b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.895942:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.895949:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833876.895987:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787833876.895991:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833876.896012:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896024:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896030:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896037:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896043:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ee00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833876.896047:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896293:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896306:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df62150bd00) 00010000:00010000:2.0:1787833876.896309:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833876.896314:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896328:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896348:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896354:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896360:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896365:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833876.896368:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896373:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896380:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df503f02800) 00010000:00010000:2.0:1787833876.896382:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833876.896385:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896401:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896428:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d49f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb0d expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896441:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb0d expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.896448:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df503f02b00) 00010000:00010000:2.0:1787833876.896450:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833876.896453:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e600, rc 0) 00000100:00100000:2.0:1787833876.896574:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+11:10495:x1874679381907328:12345-192.168.203.17@tcp:101:chown.0 Request processed in 908us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833876.896581:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:0.0:1787833876.900176:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833876.900274:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381907456 00000100:00100000:1.0:1787833876.900283:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381907456 00000100:00100000:1.0:1787833876.900506:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:1.0:1787833876.900518:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a4724ace-a769-4adb-acca-a2bfbc389c92+11:10495:x1874679381907456:12345-192.168.203.17@tcp:900:chown.0 00000100:00100000:1.0:1787833876.900605:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a4724ace-a769-4adb-acca-a2bfbc389c92+11:10495:x1874679381907456:12345-192.168.203.17@tcp:900:chown.0 Request processed in 89us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833876.900613:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1787833876.903619:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833876.903702:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381907712 00000100:00100000:2.0:1787833876.903711:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381907712 00000100:00100000:2.0:1787833876.903790:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:2.0:1787833876.903801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621338f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+11:10495:x1874679381907712:12345-192.168.203.17@tcp:36:chown.0 00010000:00010000:2.0:1787833876.903854:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833876.903881:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d4b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb0d expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.903900:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df503f02b00) 00010000:00010000:2.0:1787833876.903905:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833876.903924:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.903951:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.903961:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833876.907140:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1787833876.907464:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907479:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907489:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907508:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833876.907513:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907522:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907540:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df503f02800) 00010000:00010000:0.0:1787833876.907555:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833876.907561:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907569:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d46e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907591:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907598:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907604:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907609:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833876.907612:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907618:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907626:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df503f02b00) 00010000:00010000:0.0:1787833876.907629:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833876.907632:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907639:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d475 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907653:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907670:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907677:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907682:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fe00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833876.907685:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907692:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907701:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df62150bd00) 00010000:00010000:0.0:1787833876.907704:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787833876.907707:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.907713:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d48a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833876.908424:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8dee329 reply state 00000000f1c616d4 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.908445:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.908453:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df503f02b00) 00010000:00010000:2.0:1787833876.908455:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787833876.908459:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787833876.908472:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787833876.908626:0:6514:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787833876.908657:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621338f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:10495:x1874679381907712:12345-192.168.203.17@tcp:36:chown.0 Request processed in 4854us (5041us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787833876.908667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00010000:00010000:3.0:1787833876.908808:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.908817:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.908823:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.908838:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fc00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833876.908841:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.908848:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.908858:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df503f02b00) 00010000:00010000:3.0:1787833876.908861:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787833876.908864:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.908869:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1d4bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833876.922514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833876.922585:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381907840 00000100:00100000:3.0:1787833876.922594:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381907840 00000100:00100000:3.0:1787833876.922654:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:3.0:1787833876.922664:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:10496:x1874679381907840:12345-192.168.203.17@tcp:101:touch.500 00010000:00010000:3.0:1787833876.922685:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833876.922705:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d4c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb14 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787833876.926872:0:9772:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4086us 00010000:00010000:3.0:1787833876.941510:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.941534:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.941547:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.941581:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.941589:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.941597:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.941735:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d4d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.941744:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833876.941951:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833876.942487:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787833876.942502:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833876.942547:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942561:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942568:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942584:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942590:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833876.942595:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942603:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942616:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df62150bd00) 00010000:00010000:0.0:1787833876.942619:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833876.942623:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942631:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1d4c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942645:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942651:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942657:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942663:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833876.942666:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942682:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942691:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df610177500) 00010000:00010000:0.0:1787833876.942694:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833876.942697:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942702:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d4d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.942744:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d4c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb14 expref: 8 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.944910:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb14 expref: 7 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.944921:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df610177c00) 00010000:00010000:0.0:1787833876.944924:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787833876.944927:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247e00, rc 0) 00000100:00100000:2.0:1787833876.945185:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:10496:x1874679381907840:12345-192.168.203.17@tcp:101:touch.500 Request processed in 22520us (22677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833876.945195:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:3.0:1787833876.948741:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833876.949028:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381908096 00000100:00100000:2.0:1787833876.949040:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381908096 00000100:00100000:2.0:1787833876.949174:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:2.0:1787833876.949186:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:10496:x1874679381908096:12345-192.168.203.17@tcp:101:touch.500 00010000:00010000:2.0:1787833876.949228:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833876.949253:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d4de lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb1b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.949580:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.949597:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.949609:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.949624:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.949632:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.949638:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787833876.950211:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787833876.950605:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950618:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950627:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950671:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950677:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950682:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950688:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833876.950692:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950699:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950711:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df610177c00) 00010000:00010000:2.0:1787833876.950714:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833876.950719:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950725:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d4e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833876.950739:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012e6b685 reply state 00000000fa3ae012 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950784:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950792:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff8df62150bc00) 00010000:00010000:2.0:1787833876.950800:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787833876.950804:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787833876.950841:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d4de lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb1b expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950856:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb1b expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.950863:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df62150b300) 00010000:00010000:2.0:1787833876.950865:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833876.950867:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4ee00, rc 0) 00000100:00100000:2.0:1787833876.950932:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+10:10496:x1874679381908096:12345-192.168.203.17@tcp:101:touch.500 Request processed in 1748us (2199us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787833876.950940:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:0.0:1787833876.954722:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833876.954919:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381908352 00000100:00100000:2.0:1787833876.954929:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381908352 00000100:00100000:2.0:1787833876.955013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:2.0:1787833876.955023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+10:10496:x1874679381908352:12345-192.168.203.17@tcp:36:touch.500 00010000:00010000:2.0:1787833876.955093:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833876.955121:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d4f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb1b expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.955140:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df62150b300) 00010000:00010000:2.0:1787833876.955149:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833876.955196:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.955209:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.955233:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833876.955333:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000786d4047 reply state 000000000f7bf039 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.955355:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833876.955361:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df62150b800) 00010000:00010000:2.0:1787833876.955363:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787833876.955365:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833876.955519:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+11:10496:x1874679381908352:12345-192.168.203.17@tcp:36:touch.500 Request processed in 496us (806us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787833876.955526:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:3.0:1787833876.958049:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833876.958529:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381908480 00000100:00100000:0.0:1787833876.958538:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381908480 00000100:00100000:0.0:1787833876.958593:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:0.0:1787833876.958602:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+11:10496:x1874679381908480:12345-192.168.203.17@tcp:101:touch.500 00010000:00010000:0.0:1787833876.958623:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833876.958641:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d508 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb22 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.958715:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d508 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb22 expref: 12 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.958730:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d508 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb22 expref: 12 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833876.958748:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df62150b800) 00010000:00010000:0.0:1787833876.958775:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833876.958779:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6800, rc 0) 00000100:00100000:0.0:1787833876.958833:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+12:10496:x1874679381908480:12345-192.168.203.17@tcp:101:touch.500 Request processed in 231us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833876.958840:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:2.0:1787833876.961218:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833876.961482:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381908608 00000100:00100000:3.0:1787833876.961501:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381908608 00000100:00100000:3.0:1787833876.961544:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787833876.961551:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1874679381908608:12345-192.168.203.17@tcp:8:touch.500 00010000:00080000:3.0:1787833876.961585:0:8432:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:3.0:1787833876.961612:0:8432:0:(genops.c:1385:class_connect()) connect: client a4724ace-a769-4adb-acca-a2bfbc389c92, cookie 0x996d2fb20dc1d50f 00002000:00100000:3.0:1787833876.961623:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a4724ace-a769-4adb-acca-a2bfbc389c92/ffff8df5045f0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787833876.961640:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787833876.961722:0:8432:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787833876.961924:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8df63c480000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833876.961992:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2397:x1874679381908608:12345-192.168.203.17@tcp:8:touch.500 Request processed in 440us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833876.962000:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:0.0:1787833876.964066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833876.964135:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381908736 00000100:00100000:3.0:1787833876.964145:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381908736 00000100:00100000:3.0:1787833876.964210:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:3.0:1787833876.964219:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:0:x1874679381908736:12345-192.168.203.17@tcp:2:touch.500 00000100:00080000:0.0:1787833876.964405:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787833876.976441:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1787833876.976456:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000100:00100000:0.0:1787833876.980670:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:0:x1874679381908736:12345-192.168.203.17@tcp:2:touch.500 Request processed in 16442us (16613us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787833876.980683:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:0.0:1787833876.983326:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833876.983511:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381908992 00000100:00100000:3.0:1787833876.983522:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381908992 00000100:00100000:3.0:1787833876.983580:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:3.0:1787833876.983590:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+12:10496:x1874679381908992:12345-192.168.203.17@tcp:35:touch.500 00000100:00100000:3.0:1787833876.983916:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+13:10496:x1874679381908992:12345-192.168.203.17@tcp:35:touch.500 Request processed in 326us (599us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787833876.983924:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:2.0:1787833877.009361:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833877.009607:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381909120 00000100:00100000:0.0:1787833877.009617:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381909120 00000100:00100000:0.0:1787833877.009700:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:0.0:1787833877.009711:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+13:10497:x1874679381909120:12345-192.168.203.17@tcp:101:rm.0 00010000:00010000:0.0:1787833877.009734:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833877.009787:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d516 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb29 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.009870:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7a00/0x996d2fb20dc1d51d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.009885:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7a00/0x996d2fb20dc1d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.009896:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7a00/0x996d2fb20dc1d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833877.009934:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787833877.009938:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833877.009974:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7a00/0x996d2fb20dc1d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.010000:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d516 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb29 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.010016:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7a00/0x996d2fb20dc1d51d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb29 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.010024:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df610177c00) 00010000:00010000:0.0:1787833877.010027:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833877.010030:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7a00, rc 0) 00000100:00100000:0.0:1787833877.010099:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+14:10497:x1874679381909120:12345-192.168.203.17@tcp:101:rm.0 Request processed in 390us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833877.010106:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00080000:2.0:1787833877.010716:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833877.014534:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833877.014859:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381909376 00000100:00100000:2.0:1787833877.014868:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381909376 00000100:00100000:2.0:1787833877.014927:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:2.0:1787833877.014938:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+14:10497:x1874679381909376:12345-192.168.203.17@tcp:101:rm.0 00010000:00010000:2.0:1787833877.014957:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833877.014978:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d524 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833877.015237:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787833877.015373:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d524 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb30 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.015395:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df62150bd00) 00010000:00010000:2.0:1787833877.015398:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833877.015404:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb30 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.015417:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e600, rc 0) 00000100:00100000:2.0:1787833877.015528:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+15:10497:x1874679381909376:12345-192.168.203.17@tcp:101:rm.0 Request processed in 592us (1003us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1787833877.015535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:3.0:1787833877.027285:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833877.027383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381909504 00000100:00100000:2.0:1787833877.027393:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381909504 00000100:00100000:2.0:1787833877.027451:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1787833877.027462:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+15:10497:x1874679381909504:12345-192.168.203.17@tcp:37:rm.0 00000100:00100000:2.0:1787833877.032403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+15:10497:x1874679381909504:12345-192.168.203.17@tcp:37:rm.0 Request processed in 4933us (5117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833877.032416:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:0.0:1787833877.036385:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833877.041667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381909760 00000100:00100000:3.0:1787833877.041681:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381909760 00000100:00100000:3.0:1787833877.041776:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1787833877.041788:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df610441850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+15:10497:x1874679381909760:12345-192.168.203.17@tcp:35:rm.0 00000100:00100000:3.0:1787833877.042018:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df610441850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+16:10497:x1874679381909760:12345-192.168.203.17@tcp:35:rm.0 Request processed in 232us (5641us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787833877.042027:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1787833877.049680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833877.049837:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381910016 00000100:00100000:1.0:1787833877.049862:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381910016 00000100:00100000:1.0:1787833877.049922:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:1.0:1787833877.049932:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+16:10497:x1874679381910016:12345-192.168.203.17@tcp:101:rm.0 00010000:00010000:1.0:1787833877.049957:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833877.049980:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d532 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb37 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.050096:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d539 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.050112:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d539 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.050124:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d539 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833877.050135:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787833877.050247:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb37 expref: 19 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.050263:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d539 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb37 expref: 18 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.050270:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df610177c00) 00010000:00010000:1.0:1787833877.050273:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833877.050275:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b600, rc 0) 00000100:00100000:1.0:1787833877.050345:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+18:10497:x1874679381910016:12345-192.168.203.17@tcp:101:rm.0 Request processed in 407us (668us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787833877.050353:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:1.0:1787833877.055035:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833877.055134:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381910144 00000100:00100000:0.0:1787833877.055143:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381910144 00000100:00100000:0.0:1787833877.055215:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:0.0:1787833877.055226:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+18:10497:x1874679381910144:12345-192.168.203.17@tcp:41:rm.0 00000004:00000024:0.0:1787833877.055283:0:13407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787833877.055359:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+18:10497:x1874679381910144:12345-192.168.203.17@tcp:41:rm.0 Request processed in 134us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833877.055367:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:0.0:1787833877.059914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833877.060014:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381910272 00000100:00100000:3.0:1787833877.060037:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381910272 00000100:00100000:3.0:1787833877.060103:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:3.0:1787833877.060113:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+18:10497:x1874679381910272:12345-192.168.203.17@tcp:101:rm.0 00010000:00010000:3.0:1787833877.060132:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833877.060152:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d547 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb3e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060218:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060232:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060244:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060254:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060262:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060268:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060402:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d55c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060411:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d55c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060417:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d55c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833877.060459:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787833877.060463:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787833877.060498:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d55c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060511:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d55c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060518:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060524:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060529:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060535:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833877.060538:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060544:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060554:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df610177c00) 00010000:00010000:3.0:1787833877.060557:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833877.060562:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060568:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d54e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060593:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060599:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060605:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060611:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fda00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833877.060614:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060620:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060629:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff8df62150bc00) 00010000:00010000:3.0:1787833877.060631:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833877.060634:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060640:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d555 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060665:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d547 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb3e expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060679:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d55c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb3e expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.060697:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df62150b800) 00010000:00010000:3.0:1787833877.060699:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833877.060702:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030600, rc 0) 00000100:00100000:3.0:1787833877.060807:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+19:10497:x1874679381910272:12345-192.168.203.17@tcp:101:rm.0 Request processed in 695us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833877.060814:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:3.0:1787833877.065705:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833877.065822:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381910528 00000100:00100000:2.0:1787833877.065832:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381910528 00000100:00100000:2.0:1787833877.065888:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:2.0:1787833877.065899:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+19:10497:x1874679381910528:12345-192.168.203.17@tcp:36:rm.0 00010000:00010000:2.0:1787833877.065953:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787833877.065980:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d55c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb3e expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066004:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6800/0x996d2fb20dc1d508 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb22 expref: 18 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066030:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df62150b800) 00010000:00010000:2.0:1787833877.066042:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7a00/0x996d2fb20dc1d51d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb29 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066051:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df610177c00) 00010000:00010000:2.0:1787833877.066072:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833877.066095:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066106:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066115:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066125:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066131:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066137:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066929:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066943:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.066965:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787833877.067187:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787833877.067197:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352980446203ns, next at 353980444198ns, rc = 0 00010000:00010000:2.0:1787833877.067239:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067249:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067256:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067264:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067270:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067275:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067297:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833877.067315:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067321:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067327:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067340:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ee00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833877.067344:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067351:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067361:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df62150b800) 00010000:00010000:2.0:1787833877.067364:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787833877.067368:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067374:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d571 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067391:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067397:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067401:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067406:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833877.067409:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067414:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067433:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df610177c00) 00010000:00010000:2.0:1787833877.067435:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833877.067438:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067443:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d563 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833877.067453:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f1c40ac reply state 00000000f6b8d4bc transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067462:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833877.067468:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff8df62150bc00) 00010000:00010000:2.0:1787833877.067470:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787833877.067473:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833877.067568:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+18:10497:x1874679381910528:12345-192.168.203.17@tcp:36:rm.0 Request processed in 1668us (1869us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787833877.067576:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00010000:00010000:3.0:1787833877.068524:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833877.068533:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.068541:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787833877.068545:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.068554:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.068567:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df62150b800) 00010000:00010000:3.0:1787833877.068570:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787833877.068573:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.068579:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d578 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.068590:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833877.068592:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833877.068593:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833877.072123:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833877.072923:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381910784 00000100:00100000:2.0:1787833877.072932:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381910784 00000100:00100000:2.0:1787833877.073016:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:2.0:1787833877.073028:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+18:10497:x1874679381910784:12345-192.168.203.17@tcp:35:rm.0 00000100:00100000:2.0:1787833877.073287:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+19:10497:x1874679381910784:12345-192.168.203.17@tcp:35:rm.0 Request processed in 261us (1171us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787833877.073294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1787833877.076677:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833877.076786:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381911040 00000100:00100000:1.0:1787833877.076796:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381911040 00000100:00100000:1.0:1787833877.076850:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:1.0:1787833877.076859:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+19:10497:x1874679381911040:12345-192.168.203.17@tcp:36:rm.0 00010000:00010000:1.0:1787833877.076913:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787833877.076939:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d539 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb37 expref: 19 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.076959:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d4d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb14 expref: 18 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.076970:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df610177c00) 00010000:00010000:1.0:1787833877.076986:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6e00/0x996d2fb20dc1d498 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb06 expref: 17 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.076994:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df62150bd00) 00010000:00010000:1.0:1787833877.077000:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833877.077021:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077032:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077042:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077072:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077098:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077105:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077201:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077210:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077217:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833877.077576:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787833877.077592:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077600:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077606:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077612:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833877.077616:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077622:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077644:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8df503f07800) 00010000:00010000:1.0:1787833877.077646:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787833877.077651:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077656:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d58d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077675:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077681:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077686:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077690:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3ac00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833877.077693:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077699:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077706:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f07100) 00010000:00010000:1.0:1787833877.077708:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833877.077711:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077716:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d57f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833877.077740:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000288c9efd reply state 00000000f90e1eca transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077792:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.077799:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df503f07b00) 00010000:00010000:1.0:1787833877.077800:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833877.077803:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833877.077874:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+18:10497:x1874679381911040:12345-192.168.203.17@tcp:36:rm.0 Request processed in 1014us (1206us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787833877.077882:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00010000:00010000:2.0:1787833877.274417:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833877.334143:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406113536:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.334229:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833877.334297:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406114048:0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.334298:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406113664:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.334337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833877.334357:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406114560:0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.334358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833877.334385:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406114176:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.334400:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833877.334420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833877.334424:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406115072:0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.334444:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406114688:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.334453:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833877.334477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833877.334497:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787833877.334506:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406113920:0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.334512:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406115200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833877.334547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833877.334552:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833877.334572:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787833877.334576:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406114432:0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.334583:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406113792:0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.334617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833877.334623:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833877.334640:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406114304:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.334668:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406114944:0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.334671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833877.334701:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406114816:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.334703:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833877.334736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833877.334740:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406113536 00000100:00100000:1.0:1787833877.334747:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406113536 00000100:00100000:3.0:1787833877.334785:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406113664 00000100:00100000:3.0:1787833877.334790:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406113664 00000100:00100000:1.0:1787833877.334816:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787833877.334820:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406114176 00000100:00100000:3.0:1787833877.334824:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406114176 00000100:00100000:1.0:1787833877.334829:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406113536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.334854:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406114688 00000100:00100000:3.0:1787833877.334857:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406114688 00000100:00100000:3.0:1787833877.334873:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406113920 00000100:00100000:3.0:1787833877.334875:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406113920 00000100:00100000:3.0:1787833877.334887:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406114304 00000100:00100000:1.0:1787833877.334887:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406113536:12345-0@lo:400:kworker.0 Request processed in 61us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833877.334891:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406114304 00000100:00100000:1.0:1787833877.334899:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787833877.334906:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406114816 00000100:00100000:3.0:1787833877.334910:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406114816 00000100:00100000:1.0:1787833877.334937:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406114048 00000100:00100000:3.0:1787833877.334942:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787833877.334943:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406114048 00000100:00100000:3.0:1787833877.334953:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406113664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.334973:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406113792 00000100:00100000:1.0:1787833877.334978:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406113792 00000100:00100000:1.0:1787833877.334995:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787833877.335001:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406113664:12345-0@lo:400:kworker.0 Request processed in 49us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833877.335003:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406114048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.335016:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787833877.335035:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787833877.335044:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406114176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335049:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406114048:12345-0@lo:400:kworker.0 Request processed in 47us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833877.335057:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787833877.335074:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787833877.335086:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406114176:12345-0@lo:400:kworker.0 Request processed in 41us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833877.335087:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406113792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.335100:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787833877.335117:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787833877.335125:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406114688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335131:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406113792:12345-0@lo:400:kworker.0 Request processed in 48us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833877.335138:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787833877.335163:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406114560 00000100:00100000:3.0:1787833877.335164:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406114688:12345-0@lo:400:kworker.0 Request processed in 39us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833877.335168:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406114560 00000100:00100000:3.0:1787833877.335175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787833877.335196:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787833877.335197:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406115072 00000100:00100000:1.0:1787833877.335201:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406115072 00000100:00100000:3.0:1787833877.335206:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406113920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335216:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406114432 00000100:00100000:1.0:1787833877.335225:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406114432 00000100:00100000:3.0:1787833877.335241:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406113920:12345-0@lo:400:kworker.0 Request processed in 38us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833877.335245:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406114944 00000100:00100000:1.0:1787833877.335248:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406114944 00000100:00100000:3.0:1787833877.335250:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787833877.335268:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787833877.335272:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787833877.335279:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406114304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335284:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406114560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.335315:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406114304:12345-0@lo:400:kworker.0 Request processed in 38us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833877.335322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787833877.335331:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406114560:12345-0@lo:400:kworker.0 Request processed in 49us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833877.335341:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787833877.335345:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787833877.335354:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406114816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335358:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787833877.335368:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406115072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.335391:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406114816:12345-0@lo:400:kworker.0 Request processed in 38us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833877.335399:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787833877.335411:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406115072:12345-0@lo:400:kworker.0 Request processed in 43us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833877.335419:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787833877.335434:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787833877.335440:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406113792:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335441:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406114432:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787833877.335462:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fbb9e00 x1874679406114304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833877.335473:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406114304:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335476:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406114432:12345-0@lo:400:kworker.0 Request processed in 35us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833877.335484:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1787833877.335500:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fbb8f00 x1874679406114816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833877.335509:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787833877.335515:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406114816:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335520:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406114944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.335532:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406113664:0@lo:400:kworker.0 00000100:00100000:3.0:1787833877.335546:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406114176:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335551:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406114944:12345-0@lo:400:kworker.0 Request processed in 34us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833877.335558:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406114688:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335559:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787833877.335601:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406113920:0@lo:400:kworker.0 00010000:00080000:1.0:1787833877.335613:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fbb83c0 x1874679406114432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833877.335634:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406114432:0@lo:400:kworker.0 00010000:00080000:1.0:1787833877.335648:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb9f0c0 x1874679406114944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833877.335656:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406114944:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335665:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406114048:0@lo:400:kworker.0 00010000:00080000:1.0:1787833877.335673:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fbba580 x1874679406114560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833877.335681:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406114560:0@lo:400:kworker.0 00010000:00080000:1.0:1787833877.335689:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb9c000 x1874679406115072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833877.335697:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406115072:0@lo:400:kworker.0 00000100:00100000:1.0:1787833877.335705:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406113536:0@lo:400:kworker.0 00000100:00100000:0.0:1787833877.335793:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406115200 00000100:00100000:0.0:1787833877.335798:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406115200 00000100:00100000:0.0:1787833877.335840:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787833877.335847:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406115200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787833877.335868:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833877.335913:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406115200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833877.335918:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1787833877.336161:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833877.336166:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833877.336169:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833877.336171:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833877.336258:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406115328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833877.336294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833877.336585:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406115328 00000100:00100000:2.0:1787833877.336590:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406115328 00000100:00100000:2.0:1787833877.336625:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787833877.336633:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406115328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833877.336645:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833877.336681:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406115328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833877.336687:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1787833877.336781:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ff1a40 x1874679406115328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833877.336797:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406115328:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787833877.336907:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb9f480 x1874679406115200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833877.336921:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406115200:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787833878.295361:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833878.358024:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833878.358055:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406115456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787833878.358123:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833878.358292:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406115456 00000100:00100000:3.0:1787833878.358309:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406115456 00000100:00100000:3.0:1787833878.358363:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787833878.358372:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406115456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787833878.358417:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787833878.358468:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406115456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833878.358477:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787833878.358566:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406115456:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787833879.319559:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833879.895171:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406115584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833879.895267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833879.895636:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406115584 00000100:00100000:0.0:1787833879.895651:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406115584 00000100:00100000:0.0:1787833879.895734:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787833879.895786:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406115584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833879.895827:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833879.895880:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406115584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833879.895887:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1787833879.895928:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f94780 x1874679406115584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833879.895958:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406115584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787833879.896074:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787833879.896189:0:8581:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355809437592ns, next at 356809434919ns, rc = 0 00000100:00100000:2.0:1787833879.896285:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406115712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833879.896314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833879.896452:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406115712 00000100:00100000:3.0:1787833879.896456:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406115712 00000100:00100000:3.0:1787833879.896503:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787833879.896520:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406115712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833879.896531:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833879.896567:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406115712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833879.896574:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1787833879.896599:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb9d2c0 x1874679406115712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833879.896612:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406115712:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787833879.896726:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787833880.341884:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833880.629109:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833880.629145:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833880.629165:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833880.629182:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833880.629216:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833880.629242:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833880.629266:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381911424 00000100:00100000:3.0:1787833880.629285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381911424 00000100:00100000:3.0:1787833880.629594:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381911680 00000100:00100000:3.0:1787833880.629612:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381911680 00000100:00100000:3.0:1787833880.629633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381911296 00000100:00100000:3.0:1787833880.629635:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381911296 00000100:00100000:3.0:1787833880.629645:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381911808 00000100:00100000:3.0:1787833880.629647:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381911808 00000100:00100000:3.0:1787833880.629661:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 229 00000100:00100000:3.0:1787833880.629670:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381911424:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833880.629775:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381911424:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 107us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833880.630410:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 229 00000100:00100000:3.0:1787833880.630440:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 230 00000100:00100000:3.0:1787833880.630450:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381911680:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833880.630508:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381911680:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 61us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833880.630658:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 230 00000100:00100000:3.0:1787833880.630672:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 231 00000100:00100000:3.0:1787833880.630679:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+18:2398:x1874679381911296:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833880.630727:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+18:2398:x1874679381911296:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 48us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833880.630734:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 231 00000100:00100000:3.0:1787833880.630747:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 232 00000100:00100000:3.0:1787833880.630778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381911808:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833880.630883:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381911808:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 106us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833880.630890:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 232 00000100:00100000:3.0:1787833880.630930:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381911552 00000100:00100000:3.0:1787833880.630936:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381911552 00000100:00100000:3.0:1787833880.630981:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00100000:3.0:1787833880.630988:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c5cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381911552:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833880.631014:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c5cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381911552:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833880.631019:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00080000:3.0:1787833880.631185:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833880.631191:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833880.631193:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787833880.632724:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381911168 00000100:00100000:2.0:1787833880.632738:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381911168 00000100:00100000:2.0:1787833880.632810:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 342 00000100:00100000:2.0:1787833880.632821:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2398:x1874679381911168:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833880.632884:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2398:x1874679381911168:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 64us (3781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833880.632899:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 342 00000001:02000400:1.0:1787833881.158739:0:13682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787833881.369110:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833881.951132:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406115840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833881.951202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833881.954414:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406115840 00000100:00100000:2.0:1787833881.954429:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406115840 00000100:00100000:2.0:1787833881.954503:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787833881.954514:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406115840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833881.954550:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833881.954649:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406115840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (3446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833881.954656:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787833881.957219:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406115840:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1787833882.067536:0:13730:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff14b02290 20000000:00000080:3.0:1787833882.067553:0:13730:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df502429800 uarg=0000000000000000 20000000:01000000:3.0:1787833882.067600:0:13730:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787833882.067967:0:13730:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787833882.067975:0:13730:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787833882.068499:0:13731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787833882.068865:0:13730:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787833882.077061:0:13730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787833882.080090:0:13730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787833882.080139:0:13730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787833882.080169:0:13730:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787833882.080190:0:13730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080208:0:13730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d421 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080225:0:13730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d42f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080232:0:13730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d43d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080238:0:13730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d44b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080248:0:13730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf1 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080254:0:13730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf8 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080262:0:13730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080302:0:13730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf8 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080316:0:13730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf8 expref: 12 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833882.080331:0:13730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406115968:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833882.080441:0:13730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf1 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080451:0:13730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf1 expref: 12 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833882.080483:0:13730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116096:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833882.080518:0:13730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d44b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080526:0:13730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d44b expref: 23 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833882.080535:0:13730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116224:0@lo:104: 00000100:00100000:3.0:1787833882.080575:0:13730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833882.080804:0:9520:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787833882.080818:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406116224 00000100:00100000:1.0:1787833882.080824:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406116224 00000100:00100000:1.0:1787833882.080866:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787833882.080875:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:13730:x1874679406116224:12345-0@lo:104: 00010000:00010000:3.0:1787833882.080884:0:13730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d43d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833882.080887:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.080893:0:13730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d43d expref: 23 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833882.080902:0:13730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116352:0@lo:104: 00000004:00080000:0.0:1787833882.081229:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787833882.081259:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1787833882.081268:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1787833882.081293:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081301:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081307:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081314:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833882.081318:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081325:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081339:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff8df62150bc00) 00010000:00010000:0.0:1787833882.081342:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833882.081353:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081359:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d4ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081376:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081382:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081387:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081392:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ec00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833882.081395:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081400:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081408:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8df62150b800) 00010000:00010000:0.0:1787833882.081410:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833882.081414:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081419:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d501 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081434:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081441:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081453:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081468:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833882.081471:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081477:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081485:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc6418ac7 (ffff8df62150bc00) 00010000:00010000:0.0:1787833882.081487:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833882.081490:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081496:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d56a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc6418ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081512:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081518:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081523:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081528:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833882.081531:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081547:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081554:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df503f07b00) 00010000:00010000:0.0:1787833882.081556:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833882.081561:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.081566:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b400/0x996d2fb20dc1d586 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833882.081983:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833882.082011:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406116480:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787833882.083321:0:13730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787833882.083397:0:13730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d42f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.083413:0:13730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d42f expref: 23 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833882.083424:0:13730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116608:0@lo:104: 00000100:00100000:3.0:1787833882.083541:0:13730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787833882.083577:0:13730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1d421 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.083603:0:13730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1d421 expref: 23 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833882.083612:0:13730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116736:0@lo:104: 00000100:00100000:3.0:1787833882.083705:0:13730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833882.083716:0:13730:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604e306c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833882.083806:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406116352 00000100:00100000:2.0:1787833882.083813:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406116352 00000100:00100000:2.0:1787833882.083850:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406116608 00000100:00100000:2.0:1787833882.083853:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406116608 00000100:00100000:2.0:1787833882.083866:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406116736 00000100:00100000:2.0:1787833882.083868:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406116736 00000100:00100000:2.0:1787833882.083880:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787833882.083889:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:13730:x1874679406116352:12345-0@lo:104: 00010000:00010000:2.0:1787833882.083901:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.083949:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833882.083954:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+6:13730:x1874679406116352:12345-0@lo:104: Request processed in 67us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.083961:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787833882.083976:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787833882.083981:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:13730:x1874679406116608:12345-0@lo:104: 00010000:00010000:2.0:1787833882.083988:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.084033:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787833882.084039:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+5:13730:x1874679406116608:12345-0@lo:104: Request processed in 58us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.084045:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787833882.084057:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787833882.084063:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:13730:x1874679406116736:12345-0@lo:104: 00010000:00010000:2.0:1787833882.084070:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.084098:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787833882.084103:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3f2e78c7-534c-47b7-a20f-32c44fb24136+4:13730:x1874679406116736:12345-0@lo:104: Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.084108:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787833882.084236:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787833882.084242:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084249:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833882.084253:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084262:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833882.084269:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833882.084275:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787833882.084310:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084317:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833882.084328:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084334:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b247600/0x996d2fb20dc1d43d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d444 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084353:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833882.084356:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084361:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833882.084364:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084370:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833882.084376:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833882.084380:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787833882.084392:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084397:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833882.084411:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084417:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b7600/0x996d2fb20dc1d42f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d436 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084425:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833882.084428:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084443:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833882.084445:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084451:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833882.084546:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833882.084552:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787833882.084567:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084572:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833882.084579:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084585:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b247200/0x996d2fb20dc1d421 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d428 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.084593:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833882.084594:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833882.084596:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833882.084603:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833882.084613:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406116992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833882.084838:0:13730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116352:0@lo:104: 00000100:00100000:2.0:1787833882.084848:0:13730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116608:0@lo:104: 00000100:00100000:2.0:1787833882.084854:0:13730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116736:0@lo:104: 00000100:00100000:3.0:1787833882.084962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833882.085092:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833882.085099:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406117120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833882.085130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833882.087613:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833882.087628:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833882.087655:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406116864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833882.087858:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833882.087866:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+3:13730:x1874679406116224:12345-0@lo:104: Request processed in 6992us (7290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833882.087877:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787833882.088513:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406116992 00000100:00100000:2.0:1787833882.088523:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406116992 00010000:00010000:2.0:1787833882.088563:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d42f expref: 24 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833882.088593:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406117120 00000100:00100000:2.0:1787833882.088596:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406117120 00010000:00010000:2.0:1787833882.088609:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d421 expref: 25 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833882.088630:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787833882.088652:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+25:3638:x1874679406116992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833882.088667:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833882.088674:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d42f expref: 25 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.088686:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d42f expref: 25 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.088705:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b246200/0x996d2fb20dc1d436 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d42f expref: 25 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833882.088711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833882.088726:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833882.088774:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406116480 00000100:00100000:0.0:1787833882.088779:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406116480 00000100:00100000:2.0:1787833882.088806:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406116992:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (3843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833882.088827:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787833882.088836:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406116480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787833882.088863:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1787833882.088899:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a902e15, atime: 0x6a902e15, ctime: 0x6a902e15, blocks: 0x0 00010000:00010000:0.0:1787833882.088906:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.088921:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1787833882.088925:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833882.088931:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.088959:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.088969:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.088977:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.088991:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1787833882.089135:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406116480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 300us (427us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787833882.089141:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787833882.090180:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833882.090196:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090206:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833882.090210:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090219:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833882.090226:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833882.090233:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787833882.090275:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090282:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833882.090294:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090300:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d44b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1d452 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090318:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833882.090322:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090344:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787833882.090348:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090357:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090374:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090381:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2a2906b/0x996d2fb20dc1d59b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.090397:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833882.090399:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833882.090400:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833882.090427:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833882.090487:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406117248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833882.090531:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833882.090556:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406116864 00000100:00100000:3.0:1787833882.090562:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406116864 00010000:00010000:3.0:1787833882.090587:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d43d expref: 25 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787833882.090744:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787833882.090777:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787833882.090814:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df502f94780/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787833882.090820:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406116480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787833882.091903:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787833882.091915:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787833882.091924:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+25:3638:x1874679406117120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833882.091943:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833882.091951:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d421 expref: 25 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833882.091964:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d421 expref: 25 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833882.091981:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1d428 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d421 expref: 25 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833882.091995:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833882.092022:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406117248 00000100:00100000:2.0:1787833882.092038:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406117248 00010000:00010000:2.0:1787833882.092070:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d44b expref: 24 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833882.092072:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406117120:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (6939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833882.092090:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787833882.092218:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787833882.092226:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3640:x1874679406116864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833882.092235:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833882.092241:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d43d expref: 23 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.092251:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d43d expref: 23 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.092262:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1d444 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d43d expref: 23 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.092285:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833882.092322:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:3640:x1874679406116864:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.092328:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787833882.092346:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787833882.092352:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3640:x1874679406117248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833882.092360:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833882.092364:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1d44b expref: 21 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.092372:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1d44b expref: 21 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833882.092382:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833882.092403:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3640:x1874679406117248:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.092409:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1787833882.092531:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3bc00/0x996d2fb20dc1d452 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1d44b expref: 20 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833882.092542:0:13730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116224:0@lo:104: 00000100:00100000:3.0:1787833882.092836:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406117248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833882.092847:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406116864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833882.092891:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406117120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833882.092899:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406116992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833882.093911:0:13730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406115968:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833882.093925:0:13730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13730:1874679406116096:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833882.094105:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:2.0:1787833882.094245:0:13730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833882.094251:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381911936 00000100:00100000:1.0:1787833882.094259:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381911936 00010000:00010000:1.0:1787833882.094289:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf8 expref: 13 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833882.094337:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:1.0:1787833882.094346:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381911936:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833882.094359:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833882.094364:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf8 expref: 13 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833882.094374:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf8 expref: 13 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833882.094391:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1d460 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf8 expref: 13 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833882.094402:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833882.094465:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:2401:x1874679381911936:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 108us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833882.094472:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:0.0:1787833882.094590:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833882.094854:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381912064 00000100:00100000:3.0:1787833882.094859:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381912064 00010000:00010000:3.0:1787833882.094878:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf1 expref: 12 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833882.094908:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:3.0:1787833882.094915:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:2401:x1874679381912064:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833882.094923:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833882.094928:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf1 expref: 12 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.094937:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf1 expref: 12 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.094949:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1d459 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eaf1 expref: 12 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.094959:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.094967:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.094981:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.094987:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.095001:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.095008:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.095013:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787833882.095016:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.095024:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.095042:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833882.095051:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833882.095081:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:2401:x1874679381912064:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 166us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833882.095088:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00010000:00010000:0.0:1787833882.095419:0:13730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.095428:0:13730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.095434:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031800/0x996d2fb20dc1d594 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833882.390794:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833882.454212:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406117376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833882.454287:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833882.457857:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406117888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833882.457928:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833882.457979:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833882.457986:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406117760:0@lo:400:kworker.0 00000100:00100000:2.0:1787833882.458010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833882.458144:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406117376 00000100:00100000:2.0:1787833882.458151:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406117376 00000100:00100000:2.0:1787833882.458261:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406117888 00000100:00100000:2.0:1787833882.458266:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406117888 00000100:00100000:2.0:1787833882.458287:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787833882.458295:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406117376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787833882.458335:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833882.458381:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406117376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.458388:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787833882.458405:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787833882.458412:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406117888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833882.458422:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833882.458447:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406117888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.458466:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787833882.458488:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406117760 00000100:00100000:2.0:1787833882.458491:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406117760 00000100:00100000:2.0:1787833882.458642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787833882.458649:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406117760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833882.458695:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406117760:12345-0@lo:400:kworker.0 Request processed in 46us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.458701:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:2.0:1787833882.458719:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833882.458778:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406117760:0@lo:400:kworker.0 00010000:00080000:2.0:1787833882.458795:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502508780 x1874679406117888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833882.458811:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406117888:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787833882.458824:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a9b480 x1874679406117376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833882.458836:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406117376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833882.460138:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406117504:0@lo:400:kworker.0 00000100:00100000:1.0:1787833882.460427:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406118272:0@lo:400:kworker.0 00000100:00100000:1.0:1787833882.460471:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406118400:0@lo:400:kworker.0 00000100:00100000:1.0:1787833882.460572:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833882.460633:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406118400 00000100:00100000:1.0:1787833882.460639:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406118400 00000100:00100000:1.0:1787833882.460688:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787833882.460697:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406118400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833882.460744:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406118400:12345-0@lo:400:kworker.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833882.460778:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787833882.460963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833882.460999:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406118016:0@lo:400:kworker.0 00000100:00080000:1.0:1787833882.461599:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833882.461615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833882.461660:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406117504 00000100:00100000:1.0:1787833882.461660:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406118272 00000100:00100000:3.0:1787833882.461665:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406117504 00000100:00100000:1.0:1787833882.461665:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406118272 00000100:00100000:3.0:1787833882.461696:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787833882.461704:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406117504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833882.461713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833882.461735:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406118528:0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.461744:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406117504:12345-0@lo:400:kworker.0 Request processed in 41us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833882.461765:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787833882.461774:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833882.462393:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406118528 00000100:00100000:3.0:1787833882.462406:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406118528 00000100:00100000:3.0:1787833882.462436:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787833882.462443:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406117504:0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.462445:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406118272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.462505:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406118272:12345-0@lo:400:kworker.0 Request processed in 62us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833882.462512:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787833882.462526:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787833882.462532:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406118528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.462631:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406118528:12345-0@lo:400:kworker.0 Request processed in 99us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833882.462638:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787833882.462664:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406117632:0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.462695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833882.462716:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406118144:0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.462740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833882.462778:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406118528:0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.462797:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406118656:0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.462822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833882.462848:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406118144 00000100:00100000:3.0:1787833882.462852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406118144 00000100:00100000:3.0:1787833882.462873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406118656 00000100:00100000:3.0:1787833882.462876:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406118656 00000100:00100000:2.0:1787833882.462890:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787833882.462903:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406118144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.462908:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787833882.462919:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406118656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833882.462952:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406118144:12345-0@lo:400:kworker.0 Request processed in 54us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833882.462964:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406118656:12345-0@lo:400:kworker.0 Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.462972:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787833882.462979:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787833882.463014:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406118016 00000100:00100000:3.0:1787833882.463018:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406118016 00000100:00100000:3.0:1787833882.463057:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406117632 00000100:00100000:3.0:1787833882.463061:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406117632 00000100:00100000:3.0:1787833882.463076:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787833882.463082:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406118016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833882.463333:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787833882.463342:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406117632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833882.463407:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406117632:12345-0@lo:400:kworker.0 Request processed in 67us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833882.463413:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787833882.463481:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406118016:12345-0@lo:400:kworker.0 Request processed in 398us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833882.463487:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787833882.463522:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406117632:0@lo:400:kworker.0 00000100:00100000:3.0:1787833882.463533:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406118144:0@lo:400:kworker.0 00000100:00100000:2.0:1787833882.463644:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406118016:0@lo:400:kworker.0 00010000:00080000:3.0:1787833882.463680:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6012ead00 x1874679406118656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833882.463693:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406118656:0@lo:400:kworker.0 00010000:00080000:0.0:1787833882.466033:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6012ea1c0 x1874679406118272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833882.466050:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406118272:0@lo:400:kworker.0 00000100:00100000:0.0:1787833882.466091:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406118400:0@lo:400:kworker.0 00000100:00080000:0.0:1787833882.466127:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833882.466132:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1787833882.874412:0:13779:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca3db9ec0 20000000:00000080:0.0:1787833882.874431:0:13779:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df504546800 uarg=0000000000000000 20000000:01000000:0.0:1787833882.874487:0:13779:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787833882.874493:0:13779:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787833882.874498:0:13779:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1787833882.878364:0:13780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1787833882.878803:0:13779:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1787833882.879041:0:13779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1787833882.879073:0:13779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1787833882.879090:0:13779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1787833882.879103:0:13779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787833882.879126:0:13779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879153:0:13779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879165:0:13779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879172:0:13779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879195:0:13779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879201:0:13779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879207:0:13779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787833882.879210:0:13779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879218:0:13779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879231:0:13779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879238:0:13779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833882.879243:0:13779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1d5a2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833883.414330:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833883.479281:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406118784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833883.479355:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833883.479572:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406118784 00000100:00100000:2.0:1787833883.479581:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406118784 00000100:00100000:2.0:1787833883.479638:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787833883.479649:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406118784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787833883.479684:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787833883.480416:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406118784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 764us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833883.480427:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787833883.480466:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406118784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787833883.959949:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833883.960151:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381912192 00000100:00100000:2.0:1787833883.960161:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381912192 00000100:00100000:2.0:1787833883.960253:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 343 00000100:00100000:2.0:1787833883.960263:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:6175:x1874679381912192:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833883.960289:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833883.960324:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d5a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb45 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833883.960574:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d5a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb45 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833883.960604:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d5a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb45 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833883.960615:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4fc00, rc 0) 00000100:00100000:2.0:1787833883.960675:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381912192:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 414us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833883.960682:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 343 00000100:00100000:2.0:1787833883.969904:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833883.969995:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381912320 00000100:00100000:1.0:1787833883.970005:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381912320 00000100:00100000:1.0:1787833883.970065:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 344 00000100:00100000:1.0:1787833883.970076:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381912320:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833883.970341:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381912320:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 266us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833883.970356:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 344 00000100:00100000:3.0:1787833883.975108:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833883.975182:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381912448 00000100:00100000:2.0:1787833883.975191:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381912448 00000100:00100000:2.0:1787833883.975249:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 345 00000100:00100000:2.0:1787833883.975260:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381912448:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833883.978673:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381912448:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 3402us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833883.978688:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 345 00000100:00100000:3.0:1787833883.987814:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833883.988085:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381912576 00000100:00100000:2.0:1787833883.988094:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381912576 00000100:00100000:2.0:1787833883.988141:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 346 00000100:00100000:2.0:1787833883.988149:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:10781:x1874679381912576:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833883.988288:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:10781:x1874679381912576:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 139us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833883.988296:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 346 00000100:00100000:0.0:1787833883.999644:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833883.999739:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381912704 00000100:00100000:2.0:1787833883.999775:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381912704 00000100:00100000:2.0:1787833883.999838:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 347 00000100:00100000:2.0:1787833883.999861:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:10781:x1874679381912704:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833883.999999:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:10781:x1874679381912704:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 140us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833884.000007:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 347 00000100:00100000:1.0:1787833884.003514:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833884.003609:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381912832 00000100:00100000:0.0:1787833884.003618:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381912832 00000100:00100000:0.0:1787833884.003669:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 348 00000100:00100000:0.0:1787833884.003679:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:6175:x1874679381912832:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833884.003694:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833884.003724:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1d5b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb4c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.003784:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1d5b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb4c expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.003795:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1d5b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb4c expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.003805:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6800, rc 0) 00000100:00100000:0.0:1787833884.003861:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381912832:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 184us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.003867:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 348 00000100:00100000:3.0:1787833884.012384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833884.012801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381912960 00000100:00100000:1.0:1787833884.012812:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381912960 00000100:00100000:1.0:1787833884.012867:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 349 00000100:00100000:1.0:1787833884.012877:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381912960:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833884.013029:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381912960:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 152us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833884.013036:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 349 00000100:00100000:3.0:1787833884.017708:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833884.017839:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381913088 00000100:00100000:2.0:1787833884.017849:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381913088 00000100:00100000:2.0:1787833884.017898:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 350 00000100:00100000:2.0:1787833884.017907:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381913088:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833884.018037:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:6175:x1874679381913088:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 130us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833884.018045:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 350 00000100:00100000:2.0:1787833884.052349:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833884.052440:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381913216 00000100:00100000:0.0:1787833884.052460:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381913216 00000100:00100000:0.0:1787833884.052513:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 351 00000100:00100000:0.0:1787833884.052522:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:10784:x1874679381913216:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787833884.052666:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:10784:x1874679381913216:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 144us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.052674:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 351 10000000:01000000:0.0:1787833884.054065:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787833884.054071:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63fb44000 from 7 10000000:01000000:0.0:1787833884.054075:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787833884.054115:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.054125:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.054157:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833884.054178:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406118912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.054229:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.054289:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6012ed840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833884.056494:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406118912 00000100:00100000:1.0:1787833884.056507:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406118912 00000100:00100000:1.0:1787833884.056590:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787833884.056599:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:6511:x1874679406118912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833884.056615:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833884.056634:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1d5be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d5b7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833884.056660:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1d5be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d5b7 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833884.056673:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1d5be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d5b7 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833884.056681:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b400, rc 0) 00000100:00100000:1.0:1787833884.056795:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406118912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833884.056803:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787833884.056964:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406118912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833884.056983:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833884.056991:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833884.057079:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833884.057116:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833884.057166:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.057510:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406119040 00000100:00100000:0.0:1787833884.057515:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406119040 00000100:00100000:0.0:1787833884.057548:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787833884.057555:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406119040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.057686:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406119040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.057693:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787833884.058655:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833884.058698:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833884.058783:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833884.058817:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.058875:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406119168 00000100:00100000:0.0:1787833884.058880:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406119168 00000100:00100000:0.0:1787833884.058920:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787833884.058938:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406119168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.059035:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406119168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.059042:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787833884.059494:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833884.062166:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13792:1874679406119296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833884.062262:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833884.062320:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469540 going to sleep for 11 seconds 00000100:00100000:2.0:1787833884.062470:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406119296 00000100:00100000:2.0:1787833884.062477:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406119296 00000100:00100000:2.0:1787833884.062528:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787833884.062537:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:13792:x1874679406119296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833884.062661:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:13792:x1874679406119296:12345-0@lo:502:llog_process_th.0 Request processed in 125us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833884.062669:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787833884.062990:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13792:1874679406119296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833884.063018:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833884.063028:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833884.063030:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787833884.063035:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df63fb44000 00000020:00000080:1.0:1787833884.063038:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787833884.063096:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833884.063100:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833884.063102:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787833884.063104:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833884.063113:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833884.063114:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787833884.063118:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df63fb44000 00000020:00000080:1.0:1787833884.063120:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787833884.063154:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13792:1874679406119424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833884.063192:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833884.063225:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df621141a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833884.063284:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406119424 00000100:00100000:3.0:1787833884.063289:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406119424 00000100:00100000:3.0:1787833884.063324:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787833884.063331:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:13792:x1874679406119424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833884.063416:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:13792:x1874679406119424:12345-0@lo:502:llog_process_th.0 Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833884.063428:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787833884.064177:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13792:1874679406119424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833884.064205:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833884.064211:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833884.064213:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787833884.064217:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787833884.065832:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787833884.065865:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833884.065876:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833884.065888:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833884.065898:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833884.065900:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df6359b9000 from 7 10000000:01000000:3.0:1787833884.065903:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833884.065936:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833884.065944:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833884.065966:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833884.065990:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833884.066051:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833884.066104:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e181900 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.066298:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406119552 00000100:00100000:0.0:1787833884.066305:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406119552 00000100:00100000:0.0:1787833884.066368:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787833884.066378:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:6511:x1874679406119552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833884.066391:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833884.066413:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6e00/0x996d2fb20dc1d5cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d5c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.066437:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6e00/0x996d2fb20dc1d5cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d5c5 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.066457:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6e00/0x996d2fb20dc1d5cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d5c5 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.066466:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6e00, rc 0) 00000100:00100000:0.0:1787833884.066508:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406119552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.066515:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787833884.066559:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833884.066573:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.066582:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833884.066641:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.066665:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.066681:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.066693:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406119680 00000100:00100000:0.0:1787833884.066696:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406119680 00000100:00100000:0.0:1787833884.066719:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787833884.066724:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406119680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.066846:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406119680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.066860:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787833884.066889:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.066917:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.066967:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.066980:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340840 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.066991:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406119808 00000100:00100000:0.0:1787833884.066993:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406119808 00000100:00100000:0.0:1787833884.067009:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787833884.067014:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406119808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.067080:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406119808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.067085:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787833884.067120:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406119808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.067285:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13793:1874679406119936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833884.067318:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.067335:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406119936 00000100:00100000:0.0:1787833884.067339:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406119936 00000100:00100000:0.0:1787833884.067358:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787833884.067363:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:13793:x1874679406119936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833884.067426:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:13793:x1874679406119936:12345-0@lo:502:llog_process_th.0 Request processed in 62us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.067432:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787833884.067471:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.067483:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13793:1874679406119936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833884.067507:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833884.067515:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833884.067517:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787833884.067523:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df6359b9000 00000020:00000080:0.0:1787833884.067526:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787833884.067573:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833884.067576:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833884.067578:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787833884.067580:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833884.067583:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833884.067584:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787833884.067587:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df6359b9000 00000020:00000080:0.0:1787833884.067590:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787833884.067620:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13793:1874679406120064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833884.067651:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.067670:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406120064 00000100:00100000:0.0:1787833884.067673:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406120064 00000100:00100000:0.0:1787833884.067690:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787833884.067695:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:13793:x1874679406120064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833884.067747:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:13793:x1874679406120064:12345-0@lo:502:llog_process_th.0 Request processed in 51us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.067778:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787833884.067806:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.067817:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13793:1874679406120064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833884.067834:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833884.067838:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833884.067839:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787833884.067842:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787833884.067892:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787833884.067907:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787833884.067914:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.067923:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833884.067932:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787833884.067935:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63b1db800 from 7 10000000:01000000:0.0:1787833884.067938:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787833884.067957:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.067964:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.067972:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833884.067985:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.068010:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.068022:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.068032:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406120192 00000100:00100000:0.0:1787833884.068035:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406120192 00000100:00100000:0.0:1787833884.068054:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787833884.068059:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:6511:x1874679406120192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833884.068067:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833884.068076:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6000/0x996d2fb20dc1d5da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d5d3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.068104:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6000/0x996d2fb20dc1d5da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d5d3 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.068112:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6000/0x996d2fb20dc1d5da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d5d3 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.068119:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6000, rc 0) 00000100:00100000:0.0:1787833884.068147:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406120192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.068153:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787833884.068181:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833884.068191:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.068198:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833884.068235:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.068262:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.068273:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b2ac240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.068283:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406120320 00000100:00100000:0.0:1787833884.068286:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406120320 00000100:00100000:0.0:1787833884.068304:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787833884.068309:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406120320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.068369:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406120320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.068383:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787833884.068408:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.068427:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.068467:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.068480:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.068489:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406120448 00000100:00100000:0.0:1787833884.068492:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406120448 00000100:00100000:0.0:1787833884.068508:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787833884.068513:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406120448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.068563:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406120448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 49us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.068569:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787833884.068597:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.068801:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13794:1874679406120576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833884.068828:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.068843:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406120576 00000100:00100000:0.0:1787833884.068846:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406120576 00000100:00100000:0.0:1787833884.068862:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787833884.068867:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:13794:x1874679406120576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833884.068915:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:13794:x1874679406120576:12345-0@lo:502:llog_process_th.0 Request processed in 48us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.068921:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787833884.068943:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.068953:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13794:1874679406120576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833884.068971:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833884.068977:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833884.068979:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787833884.068983:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df63b1db800 00000020:00000080:0.0:1787833884.068986:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787833884.069015:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833884.069018:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833884.069019:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787833884.069022:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833884.069024:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833884.069025:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787833884.069028:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df63b1db800 00000020:00000080:0.0:1787833884.069030:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787833884.069053:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13794:1874679406120704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833884.069079:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.069094:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406120704 00000100:00100000:0.0:1787833884.069097:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406120704 00000100:00100000:0.0:1787833884.069113:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787833884.069118:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:13794:x1874679406120704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833884.069166:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:13794:x1874679406120704:12345-0@lo:502:llog_process_th.0 Request processed in 48us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.069172:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787833884.069195:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.069204:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13794:1874679406120704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833884.069217:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833884.069220:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833884.069222:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787833884.069225:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787833884.069255:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787833884.069267:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787833884.069273:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.069281:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833884.069288:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787833884.069290:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df60efc3000 from 7 10000000:01000000:0.0:1787833884.069292:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787833884.069306:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.069313:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.069321:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833884.069331:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.069352:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.069362:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833884.069371:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406120832 00000100:00100000:0.0:1787833884.069374:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406120832 00000100:00100000:0.0:1787833884.069389:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787833884.069394:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:6511:x1874679406120832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833884.069400:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833884.069407:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b7600/0x996d2fb20dc1d5e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1d5e1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.069430:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7600/0x996d2fb20dc1d5e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1d5e1 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.069439:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b7600/0x996d2fb20dc1d5e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1d5e1 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833884.074140:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833884.074769:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381913344 00000100:00100000:1.0:1787833884.074778:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381913344 00000100:00100000:1.0:1787833884.074827:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 368 00000100:00100000:1.0:1787833884.074836:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:10784:x1874679381913344:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787833884.074982:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:10784:x1874679381913344:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 147us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833884.074990:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 368 00010000:00010000:0.0:1787833884.081984:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7600, rc 0) 00000100:00100000:0.0:1787833884.082100:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406120832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 12701us (12742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833884.082110:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787833884.082184:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833884.082208:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833884.082219:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833884.082315:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.083692:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.083744:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833884.083990:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406120960 00000100:00100000:1.0:1787833884.083999:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406120960 00000100:00100000:1.0:1787833884.084069:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787833884.084079:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406120960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833884.084205:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406120960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833884.084212:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787833884.090362:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406120960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.090429:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406121088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.090518:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.090551:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833884.091258:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406121088 00000100:00100000:1.0:1787833884.091274:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406121088 00000100:00100000:1.0:1787833884.091329:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787833884.091338:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406121088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833884.091470:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:6511:x1874679406121088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833884.091478:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787833884.092358:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3f2e78c7-534c-47b7-a20f-32c44fb24136:6511:1874679406121088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833884.094141:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13796:1874679406121216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833884.094219:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833884.094254:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833884.094312:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406121216 00000100:00100000:1.0:1787833884.094318:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406121216 00000100:00100000:1.0:1787833884.094372:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787833884.094381:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:13796:x1874679406121216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833884.094510:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:13796:x1874679406121216:12345-0@lo:502:llog_process_th.0 Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833884.094517:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787833884.094564:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13796:1874679406121216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833884.094592:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833884.094601:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833884.094604:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787833884.094610:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df60efc3000 00000020:00000080:1.0:1787833884.094612:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787833884.094660:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833884.094664:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833884.094665:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787833884.094668:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833884.094670:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833884.094672:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787833884.094676:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df60efc3000 00000020:00000080:1.0:1787833884.094678:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787833884.094710:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13796:1874679406121344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833884.094773:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833884.094796:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406121344 00000100:00100000:1.0:1787833884.094800:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406121344 00000100:00100000:1.0:1787833884.094823:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787833884.094829:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:13796:x1874679406121344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833884.094889:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:13796:x1874679406121344:12345-0@lo:502:llog_process_th.0 Request processed in 59us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833884.094896:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787833884.094925:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833884.094937:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3f2e78c7-534c-47b7-a20f-32c44fb24136:13796:1874679406121344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833884.094968:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833884.094973:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833884.094974:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787833884.094978:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787833884.095029:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787833884.095058:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833884.095069:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833884.095080:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833884.109945:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787833884.130161:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787833884.438016:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833885.014577:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833885.014634:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406121472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833885.014698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833885.015083:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406121472 00000100:00100000:2.0:1787833885.015090:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406121472 00000100:00100000:2.0:1787833885.015194:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787833885.015205:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406121472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787833885.015233:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833885.015299:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406121472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833885.015307:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787833885.015355:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406121472:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787833885.015735:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833885.017283:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406121600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833885.017351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833885.017519:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406121600 00000100:00100000:2.0:1787833885.017527:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406121600 00000100:00100000:2.0:1787833885.017593:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787833885.017602:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874679406121600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833885.017622:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833885.017678:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874679406121600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833885.017686:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1787833885.018039:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833885.018654:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406121600:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787833885.142598:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787833885.144446:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787833885.466986:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833885.764800:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833885.764854:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833885.764884:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833885.764907:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833885.764933:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833885.764961:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833885.764991:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381913600 00000100:00100000:3.0:1787833885.764999:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381913600 00000100:00100000:3.0:1787833885.765049:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381913728 00000100:00100000:3.0:1787833885.765052:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381913728 00000100:00100000:3.0:1787833885.765065:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381913984 00000100:00100000:3.0:1787833885.765067:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381913984 00000100:00100000:3.0:1787833885.765079:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381914112 00000100:00100000:3.0:1787833885.765081:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381914112 00000100:00100000:3.0:1787833885.765096:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 239 00000100:00100000:3.0:1787833885.765106:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381913600:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833885.765175:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381913600:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 70us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833885.765183:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 239 00000100:00100000:3.0:1787833885.765201:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 240 00000100:00100000:3.0:1787833885.765208:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381913728:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833885.765281:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381913728:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 73us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833885.765289:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 240 00000100:00100000:3.0:1787833885.765302:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 241 00000100:00100000:3.0:1787833885.765309:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381913984:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833885.765342:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381913984:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 35us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833885.765347:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 241 00000100:00100000:3.0:1787833885.765355:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 242 00000100:00100000:3.0:1787833885.765358:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381914112:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833885.765370:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381914112:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 11us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833885.765373:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 242 00000100:00100000:3.0:1787833885.765386:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381913856 00000100:00100000:1.0:1787833885.765500:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381913472 00000100:00100000:1.0:1787833885.765505:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381913472 00000100:00100000:1.0:1787833885.765550:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 373 00000100:00100000:1.0:1787833885.765562:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381913472:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833885.765590:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381913472:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 34us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833885.765596:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 373 00000100:00100000:3.0:1787833885.765629:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381913856 00000100:00080000:1.0:1787833885.765635:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833885.765640:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833885.765642:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833885.765659:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:3.0:1787833885.765665:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381913856:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833885.765690:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381913856:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833885.765696:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 92 00010000:00010000:3.0:1787833886.492269:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833887.062121:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406121728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833887.062207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833887.062316:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406121728 00000100:00100000:3.0:1787833887.062324:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406121728 00000100:00100000:3.0:1787833887.062391:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787833887.062402:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406121728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787833887.062443:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787833887.067315:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406121728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4908us (5101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833887.067329:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787833887.067371:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406121728:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787833887.509967:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833887.574033:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406122112:0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.574122:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833887.574233:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406122240:0@lo:400:kworker.0 00000100:00100000:2.0:1787833887.574275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833887.574311:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406122624:0@lo:400:kworker.0 00000100:00100000:2.0:1787833887.574324:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406122752:0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.574352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833887.574359:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833887.574375:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406123136:0@lo:400:kworker.0 00000100:00100000:2.0:1787833887.574385:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406123264:0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.574404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833887.574430:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833887.574463:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406122112 00000100:00100000:1.0:1787833887.574470:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406122112 00000100:00100000:1.0:1787833887.574515:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787833887.574524:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406122112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.574582:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406122112:12345-0@lo:400:kworker.0 Request processed in 59us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833887.574592:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406121856:0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.574606:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787833887.574632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833887.574633:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406122752 00000100:00100000:1.0:1787833887.574638:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406122752 00000100:00100000:1.0:1787833887.574678:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406123264 00000100:00100000:1.0:1787833887.574681:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406123264 00000100:00100000:1.0:1787833887.574702:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787833887.574709:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406122752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.574778:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406122752:12345-0@lo:400:kworker.0 Request processed in 70us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833887.574784:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787833887.574795:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787833887.574801:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406123264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.574825:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406123264:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833887.574830:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787833887.574921:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406121984:0@lo:400:kworker.0 00000100:00100000:3.0:1787833887.574962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833887.580481:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406122368:0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.580499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406122240 00000100:00100000:1.0:1787833887.580508:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406122240 00000100:00100000:1.0:1787833887.580564:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406122624 00000100:00100000:1.0:1787833887.580569:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406122624 00000100:00100000:0.0:1787833887.580570:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833887.580587:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406123136 00000100:00100000:1.0:1787833887.580590:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406123136 00000100:00100000:1.0:1787833887.580603:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406121984 00000100:00100000:1.0:1787833887.580605:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406121984 00000100:00100000:0.0:1787833887.580616:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406122880:0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.580622:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787833887.580632:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406122240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833887.580646:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833887.580680:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406123392:0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.580696:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406122240:12345-0@lo:400:kworker.0 Request processed in 65us (6419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833887.580704:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787833887.580710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833887.580728:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787833887.580737:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406122624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833887.580780:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406121856 00000100:00100000:0.0:1787833887.580785:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406121856 00000100:00100000:1.0:1787833887.580795:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406122624:12345-0@lo:400:kworker.0 Request processed in 59us (6452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833887.580802:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787833887.580819:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787833887.580822:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787833887.580843:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406121856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833887.580878:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406121856:12345-0@lo:400:kworker.0 Request processed in 39us (6248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833887.580885:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787833887.580912:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406122880 00000100:00100000:1.0:1787833887.580913:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406123136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833887.580916:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406122880 00000100:00100000:0.0:1787833887.580937:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406123392 00000100:00100000:0.0:1787833887.580940:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406123392 00000100:00100000:1.0:1787833887.580958:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406123136:12345-0@lo:400:kworker.0 Request processed in 117us (6553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833887.580959:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787833887.580968:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406122880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.580969:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787833887.580989:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787833887.580999:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406121984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833887.581006:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406122880:12345-0@lo:400:kworker.0 Request processed in 38us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833887.581013:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787833887.581025:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787833887.581032:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406123392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833887.581038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406121984:12345-0@lo:400:kworker.0 Request processed in 42us (6075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833887.581045:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787833887.581063:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406123392:12345-0@lo:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833887.581070:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787833887.581110:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406121856:0@lo:400:kworker.0 00000100:00100000:0.0:1787833887.581121:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406122880:0@lo:400:kworker.0 00010000:00080000:0.0:1787833887.581131:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a8c000 x1874679406123392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833887.581141:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406123392:0@lo:400:kworker.0 00000100:00100000:0.0:1787833887.581177:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406123648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833887.581209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833887.581233:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406122112:0@lo:400:kworker.0 00010000:00080000:0.0:1787833887.581243:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6012e9e00 x1874679406122624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833887.581252:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406122624:0@lo:400:kworker.0 00010000:00080000:0.0:1787833887.581261:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c1f840 x1874679406123136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833887.581270:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406123136:0@lo:400:kworker.0 00000100:00080000:0.0:1787833887.581296:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833887.581300:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833887.581302:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833887.581621:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406122368 00000100:00100000:3.0:1787833887.581626:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406122368 00000100:00100000:3.0:1787833887.581705:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787833887.581712:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406122368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833887.581765:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406122368:12345-0@lo:400:kworker.0 Request processed in 54us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833887.581771:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787833887.581806:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406121984:0@lo:400:kworker.0 00000100:00100000:3.0:1787833887.581813:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406122496:0@lo:400:kworker.0 00000100:00100000:3.0:1787833887.581834:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833887.581849:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406123008:0@lo:400:kworker.0 00000100:00100000:3.0:1787833887.581866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833887.581878:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406123520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833887.581895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833887.581999:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406123648 00000100:00100000:3.0:1787833887.582002:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406123648 00000100:00100000:3.0:1787833887.582023:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406123520 00000100:00100000:3.0:1787833887.582025:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406123520 00000100:00100000:3.0:1787833887.582035:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787833887.582040:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406123648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787833887.582061:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833887.582090:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406123648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833887.582095:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787833887.582105:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787833887.582118:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406123520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833887.582127:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833887.582148:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406123520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833887.582153:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1787833887.582176:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f97480 x1874679406123520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833887.582189:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406123520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833887.582213:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406122496 00000100:00100000:3.0:1787833887.582216:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406122496 00000100:00100000:3.0:1787833887.582234:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406123008 00000100:00100000:3.0:1787833887.582236:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406123008 00000100:00100000:3.0:1787833887.582249:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787833887.582254:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406122496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833887.582280:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406122496:12345-0@lo:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833887.582286:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787833887.582295:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787833887.582300:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406123008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833887.582468:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406122240:0@lo:400:kworker.0 00000100:00100000:2.0:1787833887.582572:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406122752:0@lo:400:kworker.0 00010000:00080000:2.0:1787833887.582584:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a8cb40 x1874679406123264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833887.582593:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406123264:0@lo:400:kworker.0 00000100:00100000:2.0:1787833887.582638:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406122496:0@lo:400:kworker.0 00010000:00080000:2.0:1787833887.582734:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a46d00 x1874679406123648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833887.582746:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406123648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833887.582780:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406122368:0@lo:400:kworker.0 00000100:00080000:0.0:1787833887.582859:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833887.583111:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406123008:12345-0@lo:400:kworker.0 Request processed in 811us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833887.583118:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787833887.583186:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406123008:0@lo:400:kworker.0 00000001:00080000:1.0:1787833888.095167:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1787833888.534024:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833888.598002:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833888.598028:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406123776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833888.598106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833888.598244:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406123776 00000100:00100000:3.0:1787833888.598252:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406123776 00000100:00100000:3.0:1787833888.598312:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787833888.598321:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406123776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787833888.598367:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787833888.598425:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406123776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833888.598432:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787833888.598631:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406123776:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787833889.557985:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833890.134486:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406123904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833890.134564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833890.136869:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406124032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833890.136940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833890.137169:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406123904 00000100:00100000:0.0:1787833890.137177:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406123904 00000100:00100000:0.0:1787833890.137246:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406124032 00000100:00100000:0.0:1787833890.137250:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406124032 00000100:00100000:0.0:1787833890.137269:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787833890.137278:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406123904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833890.137305:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833890.137356:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406123904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833890.137363:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787833890.137377:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787833890.137384:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406124032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833890.137417:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833890.137446:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406124032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833890.137451:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1787833890.138219:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833890.138284:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406123904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787833890.138662:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787833890.138668:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df502f94780, transno 4294967301 00000100:00100000:3.0:1787833890.138697:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406124032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787833890.582095:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833890.869070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833890.869112:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833890.869149:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833890.869204:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833890.869223:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833890.869248:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833890.869353:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381914240 00000100:00100000:1.0:1787833890.869363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381914240 00000100:00100000:1.0:1787833890.869420:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 375 00000100:00100000:1.0:1787833890.869435:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381914240:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833890.869508:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381914240:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 79us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833890.869516:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 375 00000100:00100000:1.0:1787833890.869839:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381914624 00000100:00100000:1.0:1787833890.869844:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381914624 00000100:00100000:1.0:1787833890.869885:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:1.0:1787833890.869900:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381914624:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833890.869935:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381914624:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833890.869942:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00080000:1.0:1787833890.869959:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833890.870252:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381914368 00000100:00100000:1.0:1787833890.870257:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381914368 00000100:00100000:0.0:1787833890.870274:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381914880 00000100:00100000:0.0:1787833890.870280:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381914880 00000100:00100000:1.0:1787833890.870295:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381914496 00000100:00100000:1.0:1787833890.870299:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381914496 00000100:00100000:0.0:1787833890.870310:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381914752 00000100:00100000:0.0:1787833890.870314:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381914752 00000100:00100000:1.0:1787833890.870327:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 249 00000100:00100000:1.0:1787833890.870338:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381914368:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833890.870345:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 250 00000100:00100000:0.0:1787833890.870356:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381914880:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833890.870384:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381914368:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 47us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833890.870393:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 249 00000100:00100000:0.0:1787833890.870407:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381914880:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 42us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833890.879550:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 250 00000100:00100000:1.0:1787833890.879564:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 251 00000100:00100000:0.0:1787833890.879590:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 252 00000100:00100000:1.0:1787833890.879600:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381914496:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833890.879604:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381914752:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833890.879683:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381914752:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 84us (10433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833890.879685:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381914496:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 108us (10459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833890.879695:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 251 00000100:00080000:1.0:1787833890.879725:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833890.879730:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833890.881625:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 252 00010000:00010000:1.0:1787833891.606155:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833892.184164:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833892.184187:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406124160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787833892.184251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833892.184421:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406124160 00000100:00100000:1.0:1787833892.184428:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406124160 00000100:00100000:1.0:1787833892.184486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787833892.184497:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406124160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787833892.184544:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787833892.184602:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406124160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833892.184610:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787833892.184703:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406124160:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787833892.637505:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833892.694066:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833892.694091:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406124288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833892.694169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833892.694489:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406124288 00000100:00100000:2.0:1787833892.694496:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406124288 00000100:00100000:2.0:1787833892.694559:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787833892.694570:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406124288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787833892.694603:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833892.694650:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406124288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833892.694657:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787833892.694728:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787833892.694777:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f41a40 x1874679406124288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833892.694796:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406124288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833892.697360:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406124672:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.697434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833892.697488:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833892.697495:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406124800:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.697521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833892.697556:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406124672 00000100:00100000:1.0:1787833892.697562:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406124672 00000100:00100000:1.0:1787833892.697603:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787833892.697611:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406124672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.697660:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406124672:12345-0@lo:400:kworker.0 Request processed in 50us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833892.697668:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787833892.697690:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406124416:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.697719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833892.697769:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406124928:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.697792:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833892.698369:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406124416 00000100:00100000:0.0:1787833892.698374:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406124416 00000100:00100000:0.0:1787833892.698416:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787833892.698424:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406124416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.698461:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406124416:12345-0@lo:400:kworker.0 Request processed in 39us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833892.698475:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787833892.698520:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406124800 00000100:00100000:0.0:1787833892.698524:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406124800 00000100:00100000:0.0:1787833892.698549:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406124928 00000100:00100000:0.0:1787833892.698553:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406124928 00000100:00100000:0.0:1787833892.698582:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787833892.698588:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406124800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.698617:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406124800:12345-0@lo:400:kworker.0 Request processed in 30us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833892.698623:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787833892.698635:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787833892.698641:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406124928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.698666:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406124928:12345-0@lo:400:kworker.0 Request processed in 26us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833892.698672:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:0.0:1787833892.698688:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833892.698711:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406125184:0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.698740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833892.698782:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406125696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833892.698805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833892.698838:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406124800:0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.698850:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406124672:0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.698867:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833892.698873:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406125312:0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.698894:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833892.698927:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406125184 00000100:00100000:0.0:1787833892.698931:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406125184 00000100:00100000:0.0:1787833892.698958:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406125312 00000100:00100000:0.0:1787833892.698961:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406125312 00000100:00100000:0.0:1787833892.698979:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787833892.698986:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502511680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406125184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.699020:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502511680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406125184:12345-0@lo:400:kworker.0 Request processed in 35us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833892.699027:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787833892.699038:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787833892.699043:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406125312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.699069:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406125312:12345-0@lo:400:kworker.0 Request processed in 26us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833892.699075:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1787833892.699088:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833892.699107:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406125312:0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.699116:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406125184:0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.699168:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406125696 00000100:00100000:0.0:1787833892.699171:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406125696 00000100:00100000:0.0:1787833892.699206:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787833892.699213:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406125696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833892.699228:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833892.699276:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406125696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833892.699282:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1787833892.699300:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787833892.699315:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5025130c0 x1874679406125696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833892.699336:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406125696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833892.699719:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787833892.699732:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406125440:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.699777:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833892.699804:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406124544:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.699825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833892.699842:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406125056:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.699863:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833892.699881:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406124416:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.699892:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406124928:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.699915:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406125440 00000100:00100000:1.0:1787833892.699918:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406125440 00000100:00100000:1.0:1787833892.699948:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406124544 00000100:00100000:1.0:1787833892.699951:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406124544 00000100:00100000:1.0:1787833892.699964:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406125056 00000100:00100000:1.0:1787833892.699966:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406125056 00000100:00100000:0.0:1787833892.700188:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787833892.700197:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406125440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.700246:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406125440:12345-0@lo:400:kworker.0 Request processed in 51us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833892.700260:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787833892.700275:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787833892.700281:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406124544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.700309:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406124544:12345-0@lo:400:kworker.0 Request processed in 28us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833892.700314:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:0.0:1787833892.700342:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833892.700345:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833892.700374:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406125440:0@lo:400:kworker.0 00000100:00100000:0.0:1787833892.700394:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406124544:0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.700566:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787833892.700573:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406125056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833892.700608:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406125056:12345-0@lo:400:kworker.0 Request processed in 37us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833892.700614:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00010000:00080000:1.0:1787833892.700640:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb86580 x1874679406125056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833892.700651:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406125056:0@lo:400:kworker.0 00000100:00100000:2.0:1787833892.702679:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406125568:0@lo:400:kworker.0 00000100:00100000:2.0:1787833892.702746:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833892.702916:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406125568 00000100:00100000:0.0:1787833892.702924:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406125568 00000100:00100000:0.0:1787833892.703112:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787833892.703126:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406125568:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787833892.703249:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833892.703352:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406125568:12345-0@lo:400:kworker.0 Request processed in 229us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833892.703360:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:3.0:1787833892.706320:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb85680 x1874679406125568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833892.706338:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406125568:0@lo:400:kworker.0 00010000:00010000:0.0:1787833893.653945:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833893.724027:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406125824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787833893.724107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833893.730363:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406125824 00000100:00100000:1.0:1787833893.730388:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406125824 00000100:00100000:1.0:1787833893.730442:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787833893.730451:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406125824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787833893.730488:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787833893.730574:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406125824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (6467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833893.730581:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787833893.730819:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406125824:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787833894.678205:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833895.254037:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406125952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833895.254273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833895.255003:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406125952 00000100:00100000:2.0:1787833895.255012:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406125952 00000100:00100000:2.0:1787833895.255081:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787833895.255091:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406125952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787833895.255121:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833895.255177:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406125952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833895.255184:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787833895.255233:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406125952:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787833895.255332:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833895.256132:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502512d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406126080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833895.256176:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833895.256274:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406126080 00000100:00100000:0.0:1787833895.256280:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406126080 00000100:00100000:0.0:1787833895.256333:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787833895.256341:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406126080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833895.256356:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833895.256403:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406126080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833895.256410:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1787833895.256501:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833895.256537:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502512d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406126080:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787833895.382487:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787833895.384086:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787833895.702301:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833895.994587:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833895.995108:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833895.995142:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833895.995176:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833895.995197:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833895.995217:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833895.995400:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381915136 00000100:00100000:0.0:1787833895.995410:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381915136 00000100:00100000:0.0:1787833895.995479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381915648 00000100:00100000:0.0:1787833895.995483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381915648 00000100:00100000:0.0:1787833895.995496:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381915264 00000100:00100000:0.0:1787833895.995498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381915264 00000100:00100000:0.0:1787833895.995521:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381915520 00000100:00100000:0.0:1787833895.995524:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381915520 00000100:00100000:0.0:1787833895.995542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 259 00000100:00100000:0.0:1787833895.995551:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381915136:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833895.995627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381915136:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 76us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833895.995634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 259 00000100:00100000:0.0:1787833895.995650:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 260 00000100:00100000:0.0:1787833895.995671:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381915648:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833895.995699:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381915648:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833895.995705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 260 00000100:00100000:0.0:1787833895.995718:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 261 00000100:00100000:0.0:1787833895.995725:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381915264:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833895.995747:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381915264:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833895.995786:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 261 00000100:00100000:0.0:1787833895.995798:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 262 00000100:00100000:0.0:1787833895.995804:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381915520:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833895.995832:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381915520:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 28us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833895.995838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 262 00000100:00080000:0.0:1787833895.995860:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833895.995864:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833895.996229:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381915392 00000100:00100000:2.0:1787833895.996242:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381915392 00000100:00100000:2.0:1787833895.996297:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00100000:2.0:1787833895.996306:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381915392:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833895.996336:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381915392:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 33us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833895.996343:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00100000:1.0:1787833895.996747:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381915008 00000100:00100000:1.0:1787833895.996762:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381915008 00000100:00100000:1.0:1787833895.996803:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 377 00000100:00100000:1.0:1787833895.996811:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381915008:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833895.997682:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381915008:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 866us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833895.997691:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 377 00000100:00080000:0.0:1787833896.000660:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787833896.725903:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833897.302038:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833897.302061:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406126208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833897.302132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833897.302267:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406126208 00000100:00100000:2.0:1787833897.302275:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406126208 00000100:00100000:2.0:1787833897.302327:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787833897.302336:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406126208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833897.302377:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833897.302427:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406126208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833897.302434:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787833897.302784:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406126208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787833897.753345:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833897.817804:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833897.817828:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502512d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406126336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833897.817911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833897.817988:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406126336 00000100:00100000:3.0:1787833897.818003:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406126336 00000100:00080000:0.0:1787833897.818060:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833897.818094:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787833897.818109:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406126336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833897.818181:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833897.818280:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406126336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833897.818299:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1787833897.818364:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502512d00 x1874679406126336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833897.818385:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502512d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406126336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833897.826684:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406126464:0@lo:400:kworker.0 00000100:00100000:2.0:1787833897.826850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833897.826990:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406126464 00000100:00100000:0.0:1787833897.827004:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406126464 00000100:00100000:0.0:1787833897.827065:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787833897.827075:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406126464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833897.836318:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833897.836340:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406126720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833897.836414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833897.839061:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406126720 00000100:00100000:1.0:1787833897.839704:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406126720 00000100:00100000:1.0:1787833897.839818:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787833897.839832:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406126720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833897.839857:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833897.839862:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406126592:0@lo:400:kworker.0 00000100:00080000:2.0:1787833897.840473:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833897.840564:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406127232:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.840623:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833897.840786:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406127104:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.840817:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833897.840837:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406127616:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.840860:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833897.840887:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787833897.840894:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406126976:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.840916:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833897.840934:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406127488:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.841094:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833897.841138:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406127488 00000100:00100000:3.0:1787833897.841146:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406127488 00000100:00100000:3.0:1787833897.841564:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787833897.841577:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406127488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.841643:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406127488:12345-0@lo:400:kworker.0 Request processed in 69us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833897.841714:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1787833897.841745:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833897.841801:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406127488:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.841866:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406126592 00000100:00100000:3.0:1787833897.841887:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406126592 00000100:00100000:3.0:1787833897.841916:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406127104 00000100:00100000:3.0:1787833897.841919:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406127104 00000100:00100000:3.0:1787833897.841938:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406127616 00000100:00100000:3.0:1787833897.841940:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406127616 00000100:00100000:3.0:1787833897.842122:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406126976 00000100:00100000:3.0:1787833897.842126:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406126976 00000100:00100000:3.0:1787833897.842142:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787833897.842148:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406126592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.842492:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406126592:12345-0@lo:400:kworker.0 Request processed in 342us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833897.842615:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787833897.842633:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787833897.842640:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406127104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.842817:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406127104:12345-0@lo:400:kworker.0 Request processed in 178us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833897.842824:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787833897.842838:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787833897.842845:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406127616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.842875:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406127616:12345-0@lo:400:kworker.0 Request processed in 31us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833897.842881:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787833897.842893:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787833897.842899:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406126976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.842926:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406126976:12345-0@lo:400:kworker.0 Request processed in 27us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833897.842931:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1787833897.843126:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833897.844436:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406126976:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.844471:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406126592:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.844486:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406127104:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.844562:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406127616:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.844625:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406126464:0@lo:400:kworker.0 00000100:00100000:2.0:1787833897.848123:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833897.849119:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406127744:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.849459:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406127232 00000100:00100000:3.0:1787833897.849470:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406127232 00000100:00100000:2.0:1787833897.849566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833897.849609:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787833897.849617:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406126848:0@lo:400:kworker.0 00000100:00100000:2.0:1787833897.849650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833897.849672:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406127360:0@lo:400:kworker.0 00000100:00100000:2.0:1787833897.849726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833897.850473:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406127744 00000100:00100000:3.0:1787833897.850484:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406127744 00000100:00100000:1.0:1787833897.850553:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406126720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10717us (14130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833897.850568:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787833897.850626:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406126848 00000100:00100000:1.0:1787833897.850636:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406126848 00000100:00100000:2.0:1787833897.850653:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406127360 00000100:00100000:2.0:1787833897.850659:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406127360 00000100:00100000:1.0:1787833897.850709:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787833897.850717:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787833897.850730:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406126848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833897.850841:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406126848:12345-0@lo:400:kworker.0 Request processed in 117us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833897.850848:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00080000:1.0:1787833897.850908:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503c0e1c0 x1874679406126720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833897.850929:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406126720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833897.850965:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406126848:0@lo:400:kworker.0 00000100:00100000:1.0:1787833897.851045:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787833897.851331:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406126464:12345-0@lo:400:kworker.0 Request processed in 24255us (24479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833897.851340:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787833897.851483:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787833897.851595:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406127232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833897.851609:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406127360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833897.851698:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406127360:12345-0@lo:400:kworker.0 Request processed in 971us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833897.851707:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787833897.855358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406127232:12345-0@lo:400:kworker.0 Request processed in 4284us (7224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833897.855372:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1787833897.855413:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833897.855418:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787833897.872188:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406127360:0@lo:400:kworker.0 00010000:00080000:1.0:1787833897.872232:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb85a40 x1874679406127232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833897.872242:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406127232:0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.876262:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406127744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833897.876542:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406127744:12345-0@lo:400:kworker.0 Request processed in 25049us (26975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833897.876555:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:1.0:1787833897.880048:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fbb8000 x1874679406127744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833897.880065:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406127744:0@lo:400:kworker.0 00010000:00010000:3.0:1787833898.775370:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833898.839179:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406127872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787833898.839299:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833898.839516:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406127872 00000100:00100000:1.0:1787833898.839528:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406127872 00000100:00100000:1.0:1787833898.839595:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787833898.839606:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406127872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787833898.839668:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787833898.839729:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406127872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833898.839737:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787833898.840721:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406127872:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787833899.798169:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833900.374575:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406128000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787833900.374699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833900.374796:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406128128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833900.374835:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833900.374911:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406128000 00000100:00100000:2.0:1787833900.374922:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406128000 00000100:00100000:1.0:1787833900.374961:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406128128 00000100:00100000:1.0:1787833900.374967:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406128128 00000100:00080000:0.0:1787833900.375042:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833900.375115:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787833900.375128:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406128000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787833900.375171:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833900.375236:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406128000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833900.375245:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787833900.375267:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787833900.375273:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406128128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833900.375285:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833900.375548:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406128128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 274us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833900.375555:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787833900.375830:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406128128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833900.375876:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406128000:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787833900.823570:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833901.112433:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833901.112538:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833901.112577:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833901.112867:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381916032 00000100:00100000:0.0:1787833901.112880:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381916032 00000100:00100000:0.0:1787833901.112958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381915904 00000100:00100000:0.0:1787833901.112962:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381915904 00000100:00100000:0.0:1787833901.112987:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 269 00000100:00100000:0.0:1787833901.113001:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381916032:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833901.113096:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381916032:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 99us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833901.113124:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 269 00000100:00100000:0.0:1787833901.113143:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 270 00000100:00100000:0.0:1787833901.113149:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381915904:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833901.113173:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381915904:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833901.113179:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 270 00000100:00080000:1.0:1787833901.117433:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833901.117454:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787833901.117475:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381915776 00000100:00100000:2.0:1787833901.117492:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381915776 00000100:00100000:2.0:1787833901.117592:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 379 00000100:00100000:2.0:1787833901.117607:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381915776:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833901.117920:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381915776:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 315us (5506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833901.117930:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 379 00000100:00100000:1.0:1787833901.138855:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833901.148571:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381916160 00000100:00100000:3.0:1787833901.148594:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381916160 00000100:00100000:3.0:1787833901.148723:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:3.0:1787833901.148739:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2397:x1874679381916160:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:3.0:1787833901.148798:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d50f 00000100:00080000:3.0:1787833901.148809:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8df63c480000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787833901.148886:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1787833901.149145:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+2:2397:x1874679381916160:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 409us (10308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833901.149155:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00010000:00010000:3.0:1787833901.149194:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833901.149259:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833901.149466:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833901.149499:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381916416 00000100:00100000:3.0:1787833901.149507:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381916416 00000100:00100000:3.0:1787833901.149556:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381916288 00000100:00100000:3.0:1787833901.149559:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381916288 00000100:00100000:3.0:1787833901.149583:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 271 00000100:00100000:3.0:1787833901.149592:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381916416:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833901.149648:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381916416:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 58us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833901.149656:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 271 00000100:00100000:3.0:1787833901.149668:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 272 00000100:00100000:3.0:1787833901.149674:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381916288:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833901.149699:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381916288:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833901.149706:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 272 00000100:00080000:1.0:1787833901.150202:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833901.150210:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833901.150213:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787833901.846018:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833902.422719:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406128256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833902.422862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833902.423021:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406128256 00000100:00100000:1.0:1787833902.423048:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406128256 00000100:00100000:1.0:1787833902.423126:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787833902.423136:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406128256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787833902.423183:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787833902.425163:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406128256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2014us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833902.425270:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787833902.425413:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406128256:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787833902.871402:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833902.934044:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406128384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833902.934148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833902.934512:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406128384 00000100:00100000:0.0:1787833902.934524:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406128384 00000100:00100000:1.0:1787833902.934715:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833902.934728:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406128512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833902.934790:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787833902.934833:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833902.936088:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406128512 00000100:00100000:0.0:1787833902.936099:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406128512 00000100:00080000:0.0:1787833902.936146:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833902.936184:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787833902.936195:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406128384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833902.936236:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833902.936237:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787833902.936253:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406128512:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833902.936331:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406128384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833902.936339:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00002000:00000024:3.0:1787833902.936413:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833902.936460:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406128512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 211us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833902.936470:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787833902.936506:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406129024:0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.936546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833902.936582:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406129536:0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.936610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833902.936620:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406129024 00000100:00100000:3.0:1787833902.936626:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406129024 00000100:00100000:0.0:1787833902.936633:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787833902.936640:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406128640:0@lo:400:kworker.0 00000100:00100000:3.0:1787833902.936669:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787833902.936676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833902.936682:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406129024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833902.936726:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406129024:12345-0@lo:400:kworker.0 Request processed in 47us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833902.936734:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787833902.937150:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406129536 00000100:00100000:1.0:1787833902.937156:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406129536 00000100:00100000:0.0:1787833902.937793:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406129152:0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.937840:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787833902.937841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833902.937855:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406129536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.937913:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406129536:12345-0@lo:400:kworker.0 Request processed in 62us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833902.937922:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406129664:0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.937923:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787833902.937954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787833902.937985:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba6940 x1874679406128512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833902.937990:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406129024:0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.938010:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406129536:0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.938016:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406128512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833902.938051:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503c1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406128896:0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.938051:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406128640 00000100:00100000:0.0:1787833902.938058:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406128640 00000100:00100000:1.0:1787833902.938091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833902.938098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787833902.938107:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406128640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.938120:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406129408:0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.938155:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62071f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406128640:12345-0@lo:400:kworker.0 Request processed in 48us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833902.938158:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787833902.938205:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502f94780 x1874679406128384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833902.938233:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406128384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833902.938249:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787833902.938256:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406128768:0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.938417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833902.938429:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1787833902.938443:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406129280:0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.938472:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406129152 00000100:00100000:1.0:1787833902.938475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833902.938478:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406129152 00000100:00100000:1.0:1787833902.938500:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406129792:0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.938549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833902.938583:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406128896 00000100:00100000:1.0:1787833902.938587:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406128896 00000100:00100000:1.0:1787833902.938698:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787833902.938707:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406128896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.938863:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406128896:12345-0@lo:400:kworker.0 Request processed in 157us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833902.938870:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787833902.938896:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406129664 00000100:00100000:1.0:1787833902.938901:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406129664 00000100:00100000:2.0:1787833902.939151:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406129408 00000100:00100000:2.0:1787833902.939165:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406129408 00000100:00080000:3.0:1787833902.939989:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833902.940000:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833902.940024:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406128768 00000100:00100000:0.0:1787833902.940031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406128768 00000100:00100000:0.0:1787833902.940048:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406129280 00000100:00100000:0.0:1787833902.940051:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406129280 00000100:00100000:0.0:1787833902.940074:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406129792 00000100:00100000:0.0:1787833902.940078:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406129792 00000100:00080000:3.0:1787833902.940097:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833902.940103:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787833902.940113:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406129152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833902.940125:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787833902.940138:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406128768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.940570:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787833902.940579:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406129280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.940644:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406129152:12345-0@lo:400:kworker.0 Request processed in 531us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833902.940648:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406128768:12345-0@lo:400:kworker.0 Request processed in 512us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833902.940658:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787833902.940665:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787833902.940681:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787833902.940734:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406129280:12345-0@lo:400:kworker.0 Request processed in 155us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833902.940824:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620512940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406129792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833902.940836:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787833902.940847:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406129664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.940879:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620512940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406129792:12345-0@lo:400:kworker.0 Request processed in 57us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833902.940888:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787833902.940898:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406129664:12345-0@lo:400:kworker.0 Request processed in 52us (2943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833902.940905:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787833902.940948:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406128640:0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.940967:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406129152:0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.940983:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406129664:0@lo:400:kworker.0 00000100:00100000:1.0:1787833902.941040:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787833902.941043:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406128768:0@lo:400:kworker.0 00010000:00080000:0.0:1787833902.941066:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb6d680 x1874679406129280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833902.941078:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406129280:0@lo:400:kworker.0 00010000:00080000:0.0:1787833902.941090:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6012eb480 x1874679406129792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833902.941101:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406129792:0@lo:400:kworker.0 00000100:00100000:0.0:1787833902.941114:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503c1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406128896:0@lo:400:kworker.0 00000100:00100000:2.0:1787833902.941580:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787833902.941808:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406129408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833902.941903:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406129408:12345-0@lo:400:kworker.0 Request processed in 102us (3747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833902.941911:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787833902.942164:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406129408:0@lo:400:kworker.0 00010000:00010000:3.0:1787833903.896555:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833903.960665:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833903.960698:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406129920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787833903.960806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833903.960894:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406129920 00000100:00100000:2.0:1787833903.960901:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406129920 00000100:00100000:2.0:1787833903.960965:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787833903.960975:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406129920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787833903.961021:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787833903.961070:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406129920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833903.961077:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787833903.961129:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406129920:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787833904.917859:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833905.495862:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406130048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833905.495932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833905.496008:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406130048 00000100:00100000:2.0:1787833905.496015:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406130048 00000100:00100000:2.0:1787833905.496071:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787833905.496080:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406130048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833905.496110:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833905.498480:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406130048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2393us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833905.498494:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1787833905.498532:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833905.498585:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406130048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833905.502626:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833905.502663:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406130176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787833905.502738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833905.502816:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406130176 00000100:00100000:1.0:1787833905.502824:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406130176 00000100:00100000:1.0:1787833905.502883:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787833905.502892:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6205130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406130176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833905.502917:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833905.502969:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6205130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406130176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833905.502981:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1787833905.503004:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833905.503497:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406130176:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1787833905.623395:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787833905.630554:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787833905.944109:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833906.237320:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833906.237361:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833906.237381:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833906.237399:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833906.237424:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833906.237458:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381916800 00000100:00100000:0.0:1787833906.237466:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381916800 00000100:00100000:0.0:1787833906.237521:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381917056 00000100:00100000:0.0:1787833906.237525:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381917056 00000100:00100000:0.0:1787833906.237540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381916672 00000100:00100000:0.0:1787833906.237542:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381916672 00000100:00100000:0.0:1787833906.237555:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381916928 00000100:00100000:0.0:1787833906.237557:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381916928 00000100:00100000:0.0:1787833906.237571:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 279 00000100:00100000:0.0:1787833906.237580:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381916800:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833906.237658:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381916800:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833906.237665:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 279 00000100:00100000:0.0:1787833906.237684:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 280 00000100:00100000:0.0:1787833906.237690:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381917056:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833906.237712:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381917056:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833906.237719:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 280 00000100:00100000:0.0:1787833906.237744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 281 00000100:00100000:0.0:1787833906.237767:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381916672:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833906.237790:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381916672:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 41us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833906.237797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 281 00000100:00100000:0.0:1787833906.237807:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 282 00000100:00100000:0.0:1787833906.237813:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381916928:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833906.237829:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381916928:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 17us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833906.237975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 282 00000100:00080000:0.0:1787833906.238002:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833906.238005:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787833906.242004:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381916544 00000100:00100000:3.0:1787833906.242020:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381916544 00000100:00100000:3.0:1787833906.242106:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 381 00000100:00100000:3.0:1787833906.242117:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2398:x1874679381916544:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833906.242209:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df603bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2398:x1874679381916544:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 93us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833906.242217:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 381 00010000:00010000:2.0:1787833906.966149:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787833907.032259:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:1.0:1787833907.032268:0:8424:0:(genops.c:885:class_export_put()) final put ffff8df5045f0000/a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:1.0:1787833907.032303:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5045f0000/a4724ace-a769-4adb-acca-a2bfbc389c92 for lustre-OST0000 00000020:00000080:1.0:1787833907.032341:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df63c480000 for lustre-OST0000 00000100:00100000:0.0:1787833907.542499:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406130304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833907.542576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833907.542963:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406130304 00000100:00100000:2.0:1787833907.542972:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406130304 00000100:00100000:0.0:1787833907.543079:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787833907.543087:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406130304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787833907.543141:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787833907.543211:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406130304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833907.543217:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787833907.543370:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406130304:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787833907.990347:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833908.054238:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406130560:0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054316:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833908.054365:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406131072:0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054390:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833908.054411:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406131584:0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833908.054460:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787833908.054467:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504487c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406130688:0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833908.054510:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406131200:0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054543:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833908.054557:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406131712:0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833908.054613:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406130688 00000100:00100000:2.0:1787833908.054620:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406130688 00000100:00100000:2.0:1787833908.054664:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787833908.054673:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406130688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054740:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406130688:12345-0@lo:400:kworker.0 Request processed in 56us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833908.054747:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787833908.054792:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406131200 00000100:00100000:2.0:1787833908.054795:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406131200 00000100:00100000:2.0:1787833908.054823:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406131712 00000100:00100000:2.0:1787833908.054826:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406131712 00000100:00100000:2.0:1787833908.054842:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787833908.054849:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504572580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406131200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054881:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504572580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406131200:12345-0@lo:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833908.054887:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787833908.054898:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787833908.054903:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504571680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406131712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054929:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504571680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406131712:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833908.054936:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787833908.054971:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504487c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406130688:0@lo:400:kworker.0 00000100:00100000:2.0:1787833908.054982:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406131200:0@lo:400:kworker.0 00010000:00080000:2.0:1787833908.055001:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df503f43c00 x1874679406131712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833908.055011:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406131712:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055109:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406130432:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055144:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833908.055169:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504487840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406130944:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055192:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833908.055206:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406131456:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055226:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833908.055241:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787833908.055247:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406130816:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833908.055298:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406131328:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833908.055335:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406131840:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833908.055377:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406131328 00000100:00100000:1.0:1787833908.055380:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406131328 00000100:00100000:1.0:1787833908.055399:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406131840 00000100:00100000:1.0:1787833908.055402:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406131840 00000100:00100000:1.0:1787833908.055417:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787833908.055422:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620510b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406131328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055457:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620510b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406131328:12345-0@lo:400:kworker.0 Request processed in 35us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833908.055464:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787833908.055481:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787833908.055486:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6205121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406131840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055512:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6205121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406131840:12345-0@lo:400:kworker.0 Request processed in 27us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833908.055518:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787833908.055558:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406130432 00000100:00100000:1.0:1787833908.055561:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406130432 00000100:00100000:1.0:1787833908.055586:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787833908.055593:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406130432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055623:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406130432:12345-0@lo:400:kworker.0 Request processed in 32us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833908.055630:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787833908.055672:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6205103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406131968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833908.055699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833908.055725:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406131328:0@lo:400:kworker.0 00010000:00080000:1.0:1787833908.055736:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045721c0 x1874679406131840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833908.055744:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406131840:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055775:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406130432:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.055806:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406131968 00000100:00100000:1.0:1787833908.055809:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406131968 00000100:00100000:1.0:1787833908.055834:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787833908.055841:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620510f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406131968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833908.055861:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833908.055895:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620510f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406131968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833908.055901:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:1.0:1787833908.055927:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6205103c0 x1874679406131968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833908.055941:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6205103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406131968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833908.056024:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406130560 00000100:00100000:0.0:1787833908.056029:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406130560 00000100:00100000:0.0:1787833908.056050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406131072 00000100:00100000:0.0:1787833908.056052:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406131072 00000100:00100000:0.0:1787833908.056064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406131584 00000100:00100000:0.0:1787833908.056067:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406131584 00000100:00100000:0.0:1787833908.056076:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406130944 00000100:00100000:0.0:1787833908.056079:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406130944 00000100:00100000:0.0:1787833908.056090:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406131456 00000100:00100000:0.0:1787833908.056092:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406131456 00000100:00100000:0.0:1787833908.056103:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406130816 00000100:00100000:0.0:1787833908.056105:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406130816 00000100:00100000:0.0:1787833908.056117:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787833908.056123:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406130560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833908.056170:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406130560:12345-0@lo:400:kworker.0 Request processed in 47us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833908.056176:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787833908.056197:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787833908.056203:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406131072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833908.056232:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406131072:12345-0@lo:400:kworker.0 Request processed in 29us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833908.056238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787833908.056249:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787833908.056254:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504571a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406131584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833908.056289:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504571a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406131584:12345-0@lo:400:kworker.0 Request processed in 35us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833908.056295:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787833908.056306:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787833908.056312:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406130944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833908.056344:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406130944:12345-0@lo:400:kworker.0 Request processed in 32us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833908.056350:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787833908.056363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787833908.056368:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620513840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406131456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833908.056398:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620513840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406131456:12345-0@lo:400:kworker.0 Request processed in 30us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833908.056404:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787833908.056414:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787833908.056421:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620511e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406130816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833908.056446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620511e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406130816:12345-0@lo:400:kworker.0 Request processed in 26us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833908.056451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:0.0:1787833908.056485:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833908.056489:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833908.056491:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833908.056493:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833908.056522:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406130816:0@lo:400:kworker.0 00000100:00100000:0.0:1787833908.056531:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504487840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406130944:0@lo:400:kworker.0 00000100:00100000:0.0:1787833908.056539:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406131456:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.061871:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504573c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406132096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833908.061949:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833908.062008:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406130560:0@lo:400:kworker.0 00010000:00080000:1.0:1787833908.062023:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5044861c0 x1874679406131072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833908.062052:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406131072:0@lo:400:kworker.0 00010000:00080000:1.0:1787833908.062067:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5044852c0 x1874679406131584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833908.062075:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406131584:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.062122:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406132096 00000100:00100000:1.0:1787833908.062128:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406132096 00000100:00100000:1.0:1787833908.062166:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787833908.062173:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6205103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406132096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833908.062196:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833908.062232:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6205103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406132096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833908.062239:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:1.0:1787833908.062286:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504573c00 x1874679406132096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833908.062300:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504573c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406132096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787833909.014085:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833909.078681:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833909.078704:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504572d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406132224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833909.078795:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833909.079332:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406132224 00000100:00100000:2.0:1787833909.079342:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406132224 00000100:00100000:2.0:1787833909.079402:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787833909.079411:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620511a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406132224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787833909.079447:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787833909.079509:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620511a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406132224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833909.079517:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787833909.079891:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504572d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406132224:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787833910.044652:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787833910.568327:0:14060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:31:48 (1787833908) 00000100:00100000:1.0:1787833910.623473:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6205112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406132352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787833910.623563:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833910.623642:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406132352 00000100:00100000:1.0:1787833910.623649:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406132352 00000100:00100000:1.0:1787833910.623705:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787833910.623715:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620512580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406132352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833910.623743:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833910.623806:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620512580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406132352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833910.623813:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1787833910.623834:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833910.623867:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6205112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406132352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787833910.628416:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833910.628438:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6205112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406132480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833910.628505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833910.628588:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406132480 00000100:00100000:2.0:1787833910.628596:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406132480 00000100:00100000:2.0:1787833910.628669:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787833910.628678:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620511680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406132480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833910.628700:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833910.628743:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620511680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406132480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833910.628912:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1787833910.630386:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833910.630438:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6205112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406132480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787833911.063200:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833911.354008:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833911.354053:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833911.354083:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833911.354119:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833911.354157:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833911.354184:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381917440 00000100:00100000:0.0:1787833911.354193:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381917440 00000100:00100000:0.0:1787833911.354248:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381917696 00000100:00100000:0.0:1787833911.354263:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381917696 00000100:00100000:0.0:1787833911.354279:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381917312 00000100:00100000:0.0:1787833911.354282:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381917312 00000100:00100000:0.0:1787833911.354292:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381917568 00000100:00100000:0.0:1787833911.354294:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381917568 00000100:00100000:0.0:1787833911.354310:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 289 00000100:00100000:0.0:1787833911.354319:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381917440:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833911.354393:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381917440:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 74us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833911.354401:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 289 00000100:00100000:0.0:1787833911.354418:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 290 00000100:00100000:0.0:1787833911.354424:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381917696:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833911.354466:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381917696:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 42us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833911.354473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 290 00000100:00100000:0.0:1787833911.354485:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 291 00000100:00100000:0.0:1787833911.354492:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381917312:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833911.354515:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381917312:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 25us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833911.354520:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 291 00000100:00100000:0.0:1787833911.354530:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 292 00000100:00100000:0.0:1787833911.354536:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381917568:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833911.354556:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381917568:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 20us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833911.354561:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 292 00000100:00080000:1.0:1787833911.355287:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833911.355293:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787833911.355540:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381917184 00000100:00100000:3.0:1787833911.355548:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381917184 00000100:00100000:3.0:1787833911.355600:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 383 00000100:00100000:3.0:1787833911.355618:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381917184:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833911.355679:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381917184:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 71us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833911.355686:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 383 00010000:00010000:1.0:1787833912.087446:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833912.470495:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833912.470641:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381917824 00000100:00100000:2.0:1787833912.470650:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381917824 00000100:00100000:2.0:1787833912.470711:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:2.0:1787833912.470721:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:11077:x1874679381917824:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833912.470740:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833912.470803:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d5ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb53 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.470879:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d5f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.471026:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.471044:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833912.471089:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787833912.471094:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833912.471206:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.471615:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d5ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb53 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.471636:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb53 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.471645:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0c5300) 00010000:00010000:2.0:1787833912.471647:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833912.471651:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:2.0:1787833912.472066:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:11077:x1874679381917824:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1344us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833912.472075:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:0.0:1787833912.495296:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833912.496514:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381917952 00000100:00100000:2.0:1787833912.496536:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381917952 00000100:00100000:2.0:1787833912.496620:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:2.0:1787833912.496631:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c4583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:11078:x1874679381917952:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833912.496650:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833912.496670:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d5fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb5a expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.496797:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.496812:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.496823:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.496839:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.496847:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.496854:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.497808:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d612 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.497822:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d612 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.497831:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d612 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833912.497878:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787833912.497882:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833912.497967:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d612 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.497978:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.497985:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.497991:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.497996:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ec00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833912.498000:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498007:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498018:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0c5300) 00010000:00010000:2.0:1787833912.498021:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833912.498025:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498030:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498044:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498059:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498064:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498069:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833912.498071:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498077:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498085:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8df63c0c5c00) 00010000:00010000:2.0:1787833912.498087:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833912.498089:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498413:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d60b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498453:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d5fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb5a expref: 8 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498467:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d612 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb5a expref: 7 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833912.498475:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df63c0c5600) 00010000:00010000:2.0:1787833912.498477:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833912.498487:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4ee00, rc 0) 00000100:00100000:2.0:1787833912.498559:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c4583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:11078:x1874679381917952:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1930us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833912.498569:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:1.0:1787833912.518397:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833912.518576:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381918080 00000100:00100000:2.0:1787833912.518585:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381918080 00000100:00100000:2.0:1787833912.518640:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:2.0:1787833912.518650:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6205112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:11078:x1874679381918080:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787833912.518744:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6205112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:11078:x1874679381918080:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833912.518787:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1787833912.544286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833912.544386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381918336 00000100:00100000:1.0:1787833912.544397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381918336 00000100:00100000:1.0:1787833912.544459:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:1.0:1787833912.544470:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c4592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:11078:x1874679381918336:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833912.544489:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833912.544510:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1d619 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb61 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.544609:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.544623:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.544635:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.544699:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.544707:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.544714:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.547017:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d62e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.547038:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d62e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.547050:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d62e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833912.547064:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787833912.548204:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548217:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548238:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548254:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833912.548259:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548267:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548282:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df63c0c5600) 00010000:00010000:1.0:1787833912.548285:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833912.548290:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548297:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d620 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548313:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548319:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548325:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548330:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833912.548333:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548350:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548358:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df503f08c00) 00010000:00010000:1.0:1787833912.548361:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833912.548364:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.548370:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d627 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.551582:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1d619 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb61 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.551609:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d62e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb61 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.551618:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:1.0:1787833912.551621:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833912.551624:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a400, rc 0) 00000100:00100000:1.0:1787833912.551707:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c4592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:11078:x1874679381918336:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 7238us (7429us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787833912.551716:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:0.0:1787833912.559523:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833912.560041:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381918464 00000100:00100000:2.0:1787833912.560059:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381918464 00000100:00100000:2.0:1787833912.560144:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:2.0:1787833912.560157:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c458b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+9:11078:x1874679381918464:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787833912.560283:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c458b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+9:11078:x1874679381918464:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 131us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833912.560291:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:0.0:1787833912.564667:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833912.567931:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381918592 00000100:00100000:2.0:1787833912.567947:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381918592 00000100:00100000:2.0:1787833912.568059:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:2.0:1787833912.568069:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c458f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:11078:x1874679381918592:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1787833912.570824:0:9772:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2612us 00000100:00100000:3.0:1787833912.619887:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c458f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:11078:x1874679381918592:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 51808us (55219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833912.619899:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:1.0:1787833912.670476:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406132608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833912.670553:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833912.670646:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406132608 00000100:00100000:0.0:1787833912.670653:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406132608 00000100:00100000:0.0:1787833912.670704:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787833912.670712:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620513c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406132608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787833912.670743:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787833912.678416:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406132608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833912.685989:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620513c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406132608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 15268us (15427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833912.686015:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000040:00080000:2.0:1787833912.790544:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787833912.794117:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787833913.118250:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833913.174639:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406132864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833913.174712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833913.174978:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620512d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406132736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833913.175011:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833913.176341:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406133120:0@lo:400:kworker.0 00000100:00100000:0.0:1787833913.176400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833913.176506:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406133376:0@lo:400:kworker.0 00000100:00100000:2.0:1787833913.176545:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406132992:0@lo:400:kworker.0 00000100:00100000:2.0:1787833913.176576:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833913.176604:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406133504:0@lo:400:kworker.0 00000100:00100000:2.0:1787833913.176638:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833913.176662:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406134016:0@lo:400:kworker.0 00000100:00100000:2.0:1787833913.176687:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833913.176736:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406132864 00000100:00100000:2.0:1787833913.176743:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406132864 00000100:00100000:0.0:1787833913.176912:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406133632:0@lo:400:kworker.0 00000100:00100000:0.0:1787833913.176939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833913.176957:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406134144:0@lo:400:kworker.0 00000100:00100000:0.0:1787833913.176978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833913.176996:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787833913.177003:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406133248:0@lo:400:kworker.0 00000100:00100000:0.0:1787833913.177025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833913.177041:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406133760:0@lo:400:kworker.0 00000100:00100000:0.0:1787833913.177061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833913.177079:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406134272:0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.177215:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406133504 00000100:00100000:3.0:1787833913.177219:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406133504 00000100:00100000:3.0:1787833913.177282:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406133248 00000100:00100000:3.0:1787833913.177286:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406133248 00000100:00100000:3.0:1787833913.177303:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787833913.177310:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406133504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.177379:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406133504:12345-0@lo:400:kworker.0 Request processed in 69us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833913.177386:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787833913.177568:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406132992 00000100:00100000:1.0:1787833913.177579:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406132992 00000100:00100000:1.0:1787833913.177611:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787833913.177618:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406132992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833913.177655:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406132992:12345-0@lo:400:kworker.0 Request processed in 38us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833913.177661:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787833913.177696:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406133120 00000100:00100000:1.0:1787833913.177700:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406133120 00000100:00100000:1.0:1787833913.177731:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406133632 00000100:00100000:1.0:1787833913.177734:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406133632 00000100:00100000:1.0:1787833913.177778:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406134144 00000100:00100000:1.0:1787833913.177790:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406134144 00000100:00100000:3.0:1787833913.177913:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787833913.177922:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406133248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.177959:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406133248:12345-0@lo:400:kworker.0 Request processed in 39us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833913.177966:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787833913.177988:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406133760 00000100:00100000:3.0:1787833913.177991:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406133760 00000100:00100000:0.0:1787833913.178519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833913.178574:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406133248:0@lo:400:kworker.0 00000100:00100000:0.0:1787833913.178610:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406134272 00000100:00100000:0.0:1787833913.178614:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406134272 00000100:00100000:1.0:1787833913.178668:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787833913.178677:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c458780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406133120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833913.178747:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c458780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406133120:12345-0@lo:400:kworker.0 Request processed in 73us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833913.178772:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787833913.178946:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787833913.178955:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406133632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.178990:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406133632:12345-0@lo:400:kworker.0 Request processed in 37us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833913.178996:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787833913.179010:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787833913.179016:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c45a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406134144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.179043:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c45a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406134144:12345-0@lo:400:kworker.0 Request processed in 28us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833913.179049:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787833913.179060:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787833913.179066:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406133760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833913.179301:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406132736 00000100:00100000:2.0:1787833913.179306:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406132736 00000100:00100000:2.0:1787833913.179325:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787833913.179332:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406132864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833913.179355:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833913.179394:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406132864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (4682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833913.179916:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787833913.179925:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406134272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833913.179967:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406134272:12345-0@lo:400:kworker.0 Request processed in 44us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833913.179973:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00010000:00080000:1.0:1787833913.180083:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045aa1c0 x1874679406134272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833913.180097:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406134272:0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.180367:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406133760:12345-0@lo:400:kworker.0 Request processed in 1299us (3302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833913.180375:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787833913.180488:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406133120:0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.180521:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406132992:0@lo:400:kworker.0 00000100:00100000:2.0:1787833913.180557:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787833913.180580:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787833913.180590:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406132736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787833913.180605:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787833913.181340:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833913.181346:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833913.181363:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833913.181379:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406134016 00000100:00100000:0.0:1787833913.181385:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406134016 00000100:00100000:0.0:1787833913.181446:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787833913.181455:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504571e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406134016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833913.181723:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406133632:0@lo:400:kworker.0 00000100:00100000:1.0:1787833913.181737:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406134144:0@lo:400:kworker.0 00010000:00080000:1.0:1787833913.181797:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045ab480 x1874679406133760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833913.181828:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406133760:0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.182022:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406133504:0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.182509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833913.182556:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406133888:0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.182605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787833913.182636:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504570000 x1874679406132864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833913.182653:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406132864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833913.182680:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406133888 00000100:00100000:3.0:1787833913.182695:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406133888 00000100:00100000:3.0:1787833913.182733:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787833913.182740:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406133888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.182980:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406133888:12345-0@lo:400:kworker.0 Request processed in 239us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833913.182987:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787833913.183024:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406133888:0@lo:400:kworker.0 00000100:00100000:1.0:1787833913.183100:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406133376 00000100:00100000:1.0:1787833913.183117:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406133376 00000100:00100000:1.0:1787833913.183155:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787833913.183163:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406133376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833913.183203:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406133376:12345-0@lo:400:kworker.0 Request processed in 41us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833913.183209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787833913.183400:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406133376:0@lo:400:kworker.0 00000100:00100000:2.0:1787833913.184038:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406132736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3448us (9023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833913.184048:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:3.0:1787833913.184270:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df620512d00 x1874679406132736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833913.184287:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620512d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406132736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833913.184424:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504571e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406134016:12345-0@lo:400:kworker.0 Request processed in 2971us (7735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833913.184432:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1787833913.184459:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833913.184547:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406134016:0@lo:400:kworker.0 00010000:00010000:1.0:1787833914.136021:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833914.201941:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833914.201965:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406134400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833914.202036:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833914.202108:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406134400 00000100:00100000:1.0:1787833914.202115:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406134400 00000100:00100000:1.0:1787833914.202160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787833914.202169:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406134400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787833914.202205:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787833914.202264:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406134400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833914.202271:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787833914.202318:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406134400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833914.587526:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833914.587562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381918720 00000100:00100000:1.0:1787833914.587571:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381918720 00000100:00100000:1.0:1787833914.587630:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:1.0:1787833914.587648:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:11120:x1874679381918720:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833914.587668:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833914.587688:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d63c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb68 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587747:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587799:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587810:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587826:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587832:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587839:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587880:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587890:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587896:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587911:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3bc00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833914.587915:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587922:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587934:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0c5300) 00010000:00010000:1.0:1787833914.587937:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833914.587942:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587947:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587960:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587966:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587971:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587975:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833914.587978:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.587984:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.588013:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df503f0ee00) 00010000:00010000:1.0:1787833914.588015:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833914.588019:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.588025:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d64a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.588055:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d63c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb68 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.588066:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0c5300) 00010000:00010000:1.0:1787833914.588068:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833914.588072:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d63c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb68 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.588081:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a600, rc 0) 00000100:00100000:1.0:1787833914.588147:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:11120:x1874679381918720:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 501us (631us total) trans 0 rc 301/301 00000100:00100000:1.0:1787833914.588156:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00080000:0.0:1787833914.588693:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833914.594887:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833914.595179:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381918976 00000100:00100000:3.0:1787833914.595188:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381918976 00000100:00100000:3.0:1787833914.595357:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:3.0:1787833914.595368:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+9:11120:x1874679381918976:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:3.0:1787833914.595423:0:13407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833914.595450:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d5f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb53 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.595466:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0c5300) 00010000:00010000:3.0:1787833914.595476:0:13407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833914.595681:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.595695:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.595704:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.595714:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.595721:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.595727:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.597445:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.597475:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.597486:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833914.600617:0:13407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059037fe9 reply state 000000001c782609 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600645:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600654:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:3.0:1787833914.600657:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787833914.600662:0:13407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787833914.600668:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787833914.600679:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600686:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600694:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600700:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833914.600705:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600712:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600934:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:3.0:1787833914.600936:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833914.600941:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600949:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d651 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833914.600972:0:13407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059037fe9 reply state 000000001c782609 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600981:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.600988:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df602ff4300) 00010000:00010000:3.0:1787833914.600990:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787833914.600992:0:13407:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787833914.601303:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+10:11120:x1874679381918976:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 5931us (6420us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787833914.601312:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:1.0:1787833914.731084:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833914.731163:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381919104 00000100:00100000:3.0:1787833914.731172:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381919104 00000100:00100000:3.0:1787833914.731240:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:3.0:1787833914.731250:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+10:11128:x1874679381919104:12345-192.168.203.17@tcp:101:lctl.0 00010000:00010000:3.0:1787833914.731273:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833914.731295:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.731360:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1d66d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.731388:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1d66d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.731399:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1d66d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833914.731439:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787833914.731442:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787833914.731479:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1d66d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.731504:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb6f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.731522:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1d66d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb6f expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.731530:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:3.0:1787833914.731532:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833914.731536:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031600, rc 0) 00000100:00100000:3.0:1787833914.731602:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+11:11128:x1874679381919104:12345-192.168.203.17@tcp:101:lctl.0 Request processed in 354us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833914.731610:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:1.0:1787833914.815961:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833914.816052:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381919232 00000100:00100000:2.0:1787833914.816061:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381919232 00000100:00100000:2.0:1787833914.816119:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:2.0:1787833914.816143:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+11:11134:x1874679381919232:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1787833914.816164:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833914.816186:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb76 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816261:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816274:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816283:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816292:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816299:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816305:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816381:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816389:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816395:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833914.816440:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787833914.816444:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833914.816969:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816985:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816992:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.816999:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817006:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833914.817010:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817017:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817030:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:2.0:1787833914.817032:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833914.817037:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817043:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d67b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817055:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817073:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817079:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817084:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833914.817087:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817094:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817103:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df602ff4300) 00010000:00010000:2.0:1787833914.817106:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833914.817109:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817114:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d682 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817144:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb76 expref: 13 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817157:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d689 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb76 expref: 12 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.817164:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:2.0:1787833914.817166:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787833914.817174:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4ec00, rc 0) 00000100:00100000:2.0:1787833914.817286:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+12:11134:x1874679381919232:12345-192.168.203.17@tcp:101:bash.0 Request processed in 1145us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833914.817294:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:0.0:1787833914.830942:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833914.831420:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381919488 00000100:00100000:3.0:1787833914.831432:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381919488 00000100:00100000:3.0:1787833914.831705:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:3.0:1787833914.831716:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+12:11134:x1874679381919488:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833914.831737:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833914.831984:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d690 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb7d expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.832087:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.832101:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.832113:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.832129:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.832136:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.832142:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833914.833065:0:13407:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787833914.833212:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.833224:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.833244:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.833273:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.834704:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.834711:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.834718:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833914.834722:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.834731:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.834762:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:3.0:1787833914.834766:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833914.834942:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.834950:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d697 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833914.834970:0:13407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e30bd5ba reply state 00000000805c7e5e transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.834982:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.834989:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df602ff4e00) 00010000:00010000:3.0:1787833914.834991:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787833914.834994:0:13407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787833914.835200:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d690 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb7d expref: 15 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.835218:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb7d expref: 14 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.835224:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df602ff4200) 00010000:00010000:2.0:1787833914.835227:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833914.835243:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031800, rc 0) 00000100:00100000:2.0:1787833914.835325:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+15:11134:x1874679381919488:12345-192.168.203.17@tcp:101:bash.0 Request processed in 3611us (4391us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787833914.835336:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:1.0:1787833914.842073:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833914.842695:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381919616 00000100:00100000:2.0:1787833914.842710:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381919616 00000100:00100000:2.0:1787833914.842785:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:2.0:1787833914.842794:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1874679381919616:12345-192.168.203.17@tcp:8:bash.0 00010000:00080000:2.0:1787833914.842830:0:8583:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:2.0:1787833914.842864:0:8583:0:(genops.c:1385:class_connect()) connect: client a4724ace-a769-4adb-acca-a2bfbc389c92, cookie 0x996d2fb20dc1d6b3 00002000:00100000:2.0:1787833914.842875:0:8583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a4724ace-a769-4adb-acca-a2bfbc389c92/ffff8df5047ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787833914.842886:0:8583:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787833914.842969:0:8583:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787833914.843002:0:8583:0:(import.c:65:import_set_state_nolock()) ffff8df5047af800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833914.843097:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2397:x1874679381919616:12345-192.168.203.17@tcp:8:bash.0 Request processed in 302us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833914.843105:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:1.0:1787833914.850858:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833914.850944:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381919744 00000100:00100000:3.0:1787833914.850966:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381919744 00000100:00100000:3.0:1787833914.851047:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:3.0:1787833914.851058:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:0:x1874679381919744:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833914.851077:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833914.851098:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb84 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833914.851123:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787833914.851142:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1787833914.851147:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833914.851156:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb84 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.851175:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb84 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833914.851189:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030200, rc 0) 00000100:00100000:3.0:1787833914.851259:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:0:x1874679381919744:12345-192.168.203.17@tcp:101:bash.0 Request processed in 203us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833914.851266:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00080000:0.0:1787833914.851342:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833914.857540:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833914.857670:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381919872 00000100:00100000:2.0:1787833914.857688:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381919872 00000100:00100000:2.0:1787833914.857745:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:2.0:1787833914.857810:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:11134:x1874679381919872:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1787833914.857830:0:8583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833914.857849:0:8583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb8b expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.857879:0:8583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb84 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.857888:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833914.857892:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833914.857897:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.857929:0:8583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb84 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.857942:0:8583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb84 expref: 8 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833914.857956:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504570b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8583:1874679406134528:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833914.858048:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787833914.860465:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833914.860538:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381920000 00000100:00100000:2.0:1787833914.860546:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381920000 00010000:00010000:2.0:1787833914.860583:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb84 expref: 9 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833914.860625:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:2.0:1787833914.860634:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e164850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381920000:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833914.860648:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833914.860683:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb84 expref: 9 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.860698:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb84 expref: 9 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.860724:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833914.860728:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833914.860735:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 9 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.860746:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 9 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833914.860820:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 9 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833914.860849:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504570780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6500:1874679406134656:192.168.203.17@tcp:105: 00000100:00100000:2.0:1787833914.860924:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787833914.863636:0:8583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1d6ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb84 expref: 9 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833914.863699:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504570b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8583:1874679406134528:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833914.863729:0:8583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833914.863744:0:8583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:1.0:1787833914.864262:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:11134:x1874679381919872:12345-192.168.203.17@tcp:101:bash.0 Request processed in 6453us (6729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833914.864273:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:2.0:1787833914.877313:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833914.878792:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504570780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6500:1874679406134656:192.168.203.17@tcp:105: 00010000:00010000:1.0:1787833914.878814:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833914.878949:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381920256 00000100:00100000:3.0:1787833914.878956:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381920256 00000100:00100000:3.0:1787833914.879012:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1787833914.879022:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+15:11134:x1874679381920256:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:1.0:1787833914.879296:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e164850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381920000:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 18661us (18838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833914.879305:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:3.0:1787833914.880424:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+16:11134:x1874679381920256:12345-192.168.203.17@tcp:35:bash.0 Request processed in 1396us (3111us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787833914.880451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:2.0:1787833915.032339:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.032441:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381920512 00000100:00100000:1.0:1787833915.032451:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381920512 00000100:00100000:1.0:1787833915.032534:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:1.0:1787833915.032544:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+16:11144:x1874679381920512:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833915.032569:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833915.032590:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d6c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb92 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833915.032693:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787833915.033187:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d6c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb92 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.033222:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:1.0:1787833915.033225:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833915.033240:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d6c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb92 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.033255:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3bc00, rc 0) 00000100:00100000:1.0:1787833915.033381:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+17:11144:x1874679381920512:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 838us (1051us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1787833915.033390:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:1.0:1787833915.040410:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833915.041445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381920768 00000100:00100000:3.0:1787833915.041470:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381920768 00000100:00100000:3.0:1787833915.041532:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:3.0:1787833915.041543:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+17:11144:x1874679381920768:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787833915.041974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+18:11144:x1874679381920768:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 431us (1576us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787833915.041983:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00010000:00010000:1.0:1787833915.158210:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833915.159449:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.159537:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381920896 00000100:00100000:1.0:1787833915.159547:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381920896 00000100:00100000:1.0:1787833915.159604:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:1.0:1787833915.159616:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504572940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+18:11150:x1874679381920896:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833915.159637:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833915.159656:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d6d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eb99 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.159723:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d6dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.159738:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d6dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.159785:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d6dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833915.159846:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787833915.159851:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833915.159869:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d6dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.159897:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d6d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb99 expref: 20 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.159915:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d6dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb99 expref: 19 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.159923:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833915.159926:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833915.159930:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a600, rc 0) 00000100:00100000:1.0:1787833915.159986:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504572940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+19:11150:x1874679381920896:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 373us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.159993:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:1.0:1787833915.174852:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833915.176871:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381921152 00000100:00100000:2.0:1787833915.176884:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381921152 00000100:00100000:2.0:1787833915.176946:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:2.0:1787833915.176956:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+19:11150:x1874679381921152:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833915.176976:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833915.176996:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d6e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eba0 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.177102:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d6eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.177116:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d6eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.177126:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d6eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833915.177138:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787833915.177256:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d6e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eba0 expref: 22 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.177275:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d6eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eba0 expref: 21 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.177297:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df602ff4200) 00010000:00010000:2.0:1787833915.177300:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833915.177304:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f600, rc 0) 00000100:00100000:2.0:1787833915.177379:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+21:11150:x1874679381921152:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 424us (2535us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787833915.177386:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:2.0:1787833915.180548:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833915.180595:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833915.180678:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381921280 00000100:00100000:3.0:1787833915.180687:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381921280 00000100:00100000:3.0:1787833915.180745:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:3.0:1787833915.180806:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504573c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+21:2400:x1874679381921280:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833915.180820:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833915.180844:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1d6eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eba0 expref: 21 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.180861:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df602ff4200) 00010000:00010000:3.0:1787833915.180865:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833915.180913:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504573c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+20:2400:x1874679381921280:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.180920:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:1.0:1787833915.181093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381921536 00000100:00100000:1.0:1787833915.181098:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381921536 00000100:00100000:1.0:1787833915.181134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:1.0:1787833915.181142:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504572d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+20:11150:x1874679381921536:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833915.181160:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833915.181174:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d6f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eba7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.181277:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d700 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.181303:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d700 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.181313:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d700 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833915.181325:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787833915.181422:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d6f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eba7 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.181436:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d700 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eba7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.181444:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df602ff4200) 00010000:00010000:1.0:1787833915.181446:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787833915.181449:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ac00, rc 0) 00000100:00100000:1.0:1787833915.181489:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504572d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11150:x1874679381921536:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 348us (950us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787833915.181496:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:2.0:1787833915.187807:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833915.187879:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381921664 00000100:00100000:3.0:1787833915.187888:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381921664 00000100:00100000:3.0:1787833915.187934:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:3.0:1787833915.187943:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2398:x1874679381921664:12345-192.168.203.17@tcp:1:lfs.0 00010000:00010000:3.0:1787833915.187997:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.188017:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 7 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.188026:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787833915.188030:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833915.188035:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.188065:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 7 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.188078:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 7 pid: 8583 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833915.188093:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb84f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874679406134784:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833915.188174:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612e609c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.196791:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb84f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874679406134784:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833915.196821:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833915.201169:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833915.201335:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381921792 00000100:00100000:0.0:1787833915.201344:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381921792 00002000:00100000:0.0:1787833915.201390:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8df504570780 x1874679381921792/t0(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:721/0 lens 504/0 e 0 to 0 dl 1787833926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833915.201402:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504570780 with x1874679381921792 ext(0->12) 00010000:00010000:0.0:1787833915.201411:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 8 pid: 8583 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.201427:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 8 pid: 8583 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833915.201435:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df504570780 00000100:00100000:0.0:1787833915.201476:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:0.0:1787833915.201487:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381921792:12345-192.168.203.17@tcp:4:lfs.0 00000001:00100000:3.0:1787833915.203725:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000100:00100000:0.0:1787833915.204428:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381921792:12345-192.168.203.17@tcp:4:lfs.0 Request processed in 2938us (3261us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787833915.204442:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00002000:00100000:0.0:1787833915.204466:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8df504570780 x1874679381921792/t4294967300(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:721/0 lens 504/448 e 0 to 0 dl 1787833926 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833915.204476:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504570780 with x1874679381921792 ext(0->12) 00010000:00010000:0.0:1787833915.204487:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 9 pid: 8583 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.204503:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 9 pid: 8583 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833915.204512:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df504570780 00000100:00100000:0.0:1787833915.214155:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833915.215912:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381921920 00000100:00100000:3.0:1787833915.215939:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381921920 00010000:00010000:3.0:1787833915.215987:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 9 pid: 8583 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833915.216037:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:3.0:1787833915.216047:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2399:x1874679381921920:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833915.216081:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787833915.216099:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787833915.216102:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787833915 00002000:00010000:3.0:1787833915.216104:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787833915 00002000:00010000:3.0:1787833915.216106:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787833915 00002000:00010000:3.0:1787833915.216107:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787833915.216114:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 9 pid: 8583 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.216127:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 9 pid: 8583 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.216149:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000870dd72a/0x996d2fb20dc1d6c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb8b expref: 9 pid: 8583 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.216166:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833915.216170:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833915.216176:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.216186:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.216238:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833915.216301:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2399:x1874679381921920:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 254us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.216309:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00010000:00010000:0.0:1787833915.217051:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.217083:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.217106:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.217114:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.217134:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.217140:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787833915.217144:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.217153:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.217167:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.217174:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b27f255/0x996d2fb20dc1d70e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833915.217254:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2398:x1874679381921664:12345-192.168.203.17@tcp:1:lfs.0 Request processed in 29310us (29455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833915.217262:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:1.0:1787833915.222463:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.222507:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381922176 00000100:00100000:1.0:1787833915.222517:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381922176 00000100:00100000:1.0:1787833915.222564:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:1.0:1787833915.222574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11150:x1874679381922176:12345-192.168.203.17@tcp:35:lfs.0 00000004:00010000:1.0:1787833915.222634:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d700 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eba7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833915.222891:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1787833915.222944:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787833915.223260:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1787833915.223296:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.223310:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb7d expref: 26 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.223320:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.223351:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb7d expref: 26 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.223364:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb7d expref: 26 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833915.223377:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874679406134912:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833915.223460:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e73b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833915.229323:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874679406134912:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833915.229357:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833915.230383:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.230558:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381922304 00000100:00100000:1.0:1787833915.230566:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381922304 00010000:00010000:1.0:1787833915.230607:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb7d expref: 27 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833915.230934:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:1.0:1787833915.230945:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+27:2401:x1874679381922304:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833915.230960:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833915.230969:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb7d expref: 27 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.230982:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb7d expref: 27 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.231004:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d6a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb7d expref: 27 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.231020:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df602ff4200) 00010000:00010000:1.0:1787833915.231026:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.231035:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.231043:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.231116:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833915.231176:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+26:2401:x1874679381922304:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 227us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.231184:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00010000:00010000:0.0:1787833915.236369:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.236386:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833915.237194:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1787833915.237348:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1787833915.237447:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406135040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833915.237601:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.237671:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833915.239415:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406135040 00000100:00100000:2.0:1787833915.239427:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406135040 00000100:00080000:1.0:1787833915.239708:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833915.239785:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787833915.239805:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1874679406135040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787833915.239934:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1874679406135040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 133us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833915.239942:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787833915.240022:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406135040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787833915.240376:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1787833915.240442:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406135168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833915.240502:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.248068:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.248374:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406135168 00000100:00100000:3.0:1787833915.248383:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406135168 00000100:00100000:1.0:1787833915.248737:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787833915.254433:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1874679406135168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787833915.255014:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6516:x1874679406135168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 6265us (14508us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787833915.255025:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787833915.255280:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406135168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787833915.255344:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1787833915.255384:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.255394:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.255402:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.255407:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3aa00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833915.255412:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.255420:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.255435:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df602ff4200) 00010000:00010000:0.0:1787833915.255438:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787833915.255892:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.255900:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d715 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787833915.256005:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787833915.256066:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787833915.256148:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391169395965ns, next at 392169393471ns, rc = 0 00000001:00080000:0.0:1787833915.256157:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1787833915.256183:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df602ff4200) 00010000:00010000:0.0:1787833915.256186:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787833915.256193:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d700 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eba7 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833915.256362:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+29:11150:x1874679381922176:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 33788us (33906us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787833915.256376:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000020:00080000:0.0:1787833915.256380:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787833915.260383:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.260486:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381922432 00000100:00100000:1.0:1787833915.260496:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381922432 00000100:00100000:1.0:1787833915.260556:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:1.0:1787833915.260566:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+29:11150:x1874679381922432:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833915.260589:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833915.260610:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1d71c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.260669:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1d71c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebae expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.260683:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1d71c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebae expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.260700:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833915.260703:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833915.260706:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a200, rc 0) 00000100:00100000:1.0:1787833915.260786:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+30:11150:x1874679381922432:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 221us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.260803:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:3.0:1787833915.264104:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.264241:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381922688 00000100:00100000:1.0:1787833915.264250:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381922688 00000100:00100000:1.0:1787833915.264317:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:1.0:1787833915.264327:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df610442450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+30:11150:x1874679381922688:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787833915.264547:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df610442450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+31:11150:x1874679381922688:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 220us (454us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787833915.264555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1787833915.386353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833915.386472:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381922944 00000100:00100000:0.0:1787833915.386481:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381922944 00000100:00100000:0.0:1787833915.386558:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:0.0:1787833915.386568:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+31:11160:x1874679381922944:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833915.386590:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833915.386611:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebb5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833915.386731:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787833915.386873:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d723 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebb5 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.386895:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:0.0:1787833915.386898:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787833915.386904:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebb5 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.386918:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7e00, rc 0) 00000100:00100000:0.0:1787833915.386977:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+32:11160:x1874679381922944:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 409us (631us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1787833915.386984:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:2.0:1787833915.390733:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833915.390947:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381923072 00000100:00100000:3.0:1787833915.390958:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381923072 00000100:00100000:3.0:1787833915.391016:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:3.0:1787833915.391027:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+32:11160:x1874679381923072:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:3.0:1787833915.391124:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391140:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391151:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391161:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391168:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391191:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391272:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391281:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391288:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833915.391334:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391348:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391354:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391361:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391366:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833915.391370:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391377:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391390:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:3.0:1787833915.391399:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833915.391404:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391411:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d731 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391425:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391430:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391435:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391440:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833915.391442:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391447:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391661:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df602ff4e00) 00010000:00010000:3.0:1787833915.391665:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833915.391669:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391675:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d738 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391686:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391698:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391704:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391709:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833915.391712:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391717:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391725:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:3.0:1787833915.391727:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833915.391730:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.391735:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d73f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833915.391862:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+32:11160:x1874679381923072:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 835us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.391870:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:3.0:1787833915.394860:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.395069:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381923328 00000100:00100000:1.0:1787833915.395086:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381923328 00000100:00100000:1.0:1787833915.395145:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:1.0:1787833915.395154:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+32:11160:x1874679381923328:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787833915.395374:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+33:11160:x1874679381923328:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 221us (523us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787833915.395382:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1787833915.456080:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833915.459381:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381923584 00000100:00100000:2.0:1787833915.459396:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381923584 00000100:00100000:2.0:1787833915.459486:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:2.0:1787833915.459496:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+33:11163:x1874679381923584:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833915.459520:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833915.459541:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d746 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebbc expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459637:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459653:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459665:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459676:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459683:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459689:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459834:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459843:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459850:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833915.459859:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787833915.459932:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459950:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459957:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459963:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833915.459967:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459975:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459987:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:2.0:1787833915.459990:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833915.459994:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.459999:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d74d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460013:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460019:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460025:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460030:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833915.460039:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460046:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460054:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df602ff4e00) 00010000:00010000:2.0:1787833915.460056:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833915.460059:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460065:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d754 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460103:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d746 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebbc expref: 36 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460117:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebbc expref: 35 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.460124:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:2.0:1787833915.460127:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833915.460129:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:2.0:1787833915.460206:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+35:11163:x1874679381923584:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 710us (4136us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787833915.460214:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:2.0:1787833915.466927:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.467069:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381923712 00000100:00100000:1.0:1787833915.467080:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381923712 00000100:00100000:1.0:1787833915.467146:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:1.0:1787833915.467157:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+35:11163:x1874679381923712:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1787833915.467234:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.467251:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.467262:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.467297:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.467322:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.467328:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.467334:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3be00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833915.467339:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.467348:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.467359:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833915.467362:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833915.467368:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.467374:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d769 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833915.467470:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+35:11163:x1874679381923712:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 315us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.467479:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:3.0:1787833915.471166:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.471273:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381923968 00000100:00100000:1.0:1787833915.471284:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381923968 00000100:00100000:1.0:1787833915.471351:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:1.0:1787833915.471360:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+35:11163:x1874679381923968:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787833915.471586:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+36:11163:x1874679381923968:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 226us (428us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787833915.471601:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1787833915.734777:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833915.734809:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406135296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833915.734876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833915.735213:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406135296 00000100:00100000:1.0:1787833915.735231:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406135296 00000100:00100000:1.0:1787833915.735298:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787833915.735308:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406135296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833915.735338:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833915.735384:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406135296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.735391:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1787833915.735457:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833915.735550:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406135424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787833915.735578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833915.735654:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406135296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833915.736008:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406135424 00000100:00100000:0.0:1787833915.736013:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406135424 00000100:00100000:0.0:1787833915.736065:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787833915.736083:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406135424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833915.736096:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833915.736136:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406135424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833915.736142:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787833915.736175:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406135424:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787833915.740219:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833915.756860:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.756971:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381924224 00000100:00100000:1.0:1787833915.756981:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381924224 00000100:00100000:1.0:1787833915.757076:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:1.0:1787833915.757084:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+36:11194:x1874679381924224:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:1.0:1787833915.757103:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833915.757118:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d770 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebc3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.757200:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d777 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.757215:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d777 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.757235:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d777 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833915.757246:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787833915.757382:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d770 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebc3 expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.757400:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d777 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebc3 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.757408:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833915.757411:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833915.757414:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ac00, rc 0) 00000100:00100000:1.0:1787833915.757519:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+38:11194:x1874679381924224:12345-192.168.203.17@tcp:101:cat.0 Request processed in 434us (667us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787833915.757527:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:2.0:1787833915.762891:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833915.762930:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.762956:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381924480 00000100:00100000:1.0:1787833915.762966:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381924480 00000100:00100000:3.0:1787833915.763000:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381924608 00000100:00100000:3.0:1787833915.763005:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381924608 00000100:00100000:1.0:1787833915.763025:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:1.0:1787833915.763037:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+39:11194:x1874679381924480:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:3.0:1787833915.763055:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1787833915.763065:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+39:2399:x1874679381924608:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833915.763086:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833915.763110:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d777 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebc3 expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.763128:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:3.0:1787833915.763133:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833915.763193:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+39:2399:x1874679381924608:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 130us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.763202:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:1.0:1787833915.763253:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+38:11194:x1874679381924480:12345-192.168.203.17@tcp:35:cat.0 Request processed in 219us (369us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1787833915.763261:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1787833915.798964:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833915.799041:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381924864 00000100:00100000:0.0:1787833915.799050:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381924864 00000100:00100000:0.0:1787833915.799195:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:0.0:1787833915.799205:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+38:11200:x1874679381924864:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:0.0:1787833915.799251:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833915.799254:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787833915.799280:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d6dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb99 expref: 38 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.799298:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833915.799303:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833915.799315:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d785 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.799406:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.799419:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebbc expref: 38 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.799428:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.799459:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebbc expref: 38 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.799471:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebbc expref: 38 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833915.799484:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b38000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406135552:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833915.799639:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833915.802218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.802416:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b38000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406135552:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833915.802443:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833915.802453:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381924992 00000100:00100000:3.0:1787833915.802459:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381924992 00010000:00010000:3.0:1787833915.802492:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebbc expref: 39 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833915.802561:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:2.0:1787833915.802579:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+39:2400:x1874679381924992:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833915.802593:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833915.802601:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebbc expref: 39 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.802615:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebbc expref: 39 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.802639:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d75b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebbc expref: 39 pid: 13407 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.802655:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:2.0:1787833915.802661:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.802671:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.802679:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.802709:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833915.802780:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+38:2400:x1874679381924992:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 202us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833915.802789:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00010000:00010000:1.0:1787833915.802866:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.802875:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833915.802903:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787833915.803042:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d785 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebca expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.803058:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebca expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.803065:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833915.803068:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833915.803071:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7200, rc 0) 00000100:00100000:1.0:1787833915.803135:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+38:11200:x1874679381924864:12345-192.168.203.17@tcp:101:dd.0 Request processed in 3931us (4179us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787833915.803142:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:0.0:1787833915.805060:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.805250:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381925120 00000100:00100000:1.0:1787833915.805259:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381925120 00000100:00100000:1.0:1787833915.805866:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:1.0:1787833915.805875:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+38:11200:x1874679381925120:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:1.0:1787833915.805895:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833915.805911:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d79a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebd1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.805940:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.805953:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.805976:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.806074:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d79a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd1 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.806085:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd1 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.806092:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833915.806095:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787833915.806099:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3aa00, rc 0) 00000100:00100000:1.0:1787833915.806157:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+39:11200:x1874679381925120:12345-192.168.203.17@tcp:101:dd.0 Request processed in 283us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.806169:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:2.0:1787833915.809881:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.809994:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381925376 00000100:00100000:1.0:1787833915.810005:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381925376 00000100:00100000:1.0:1787833915.810153:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1787833915.810165:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+39:11200:x1874679381925376:12345-192.168.203.17@tcp:36:dd.0 00010000:00010000:1.0:1787833915.810683:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.810701:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.810713:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833915.810796:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1787833915.810822:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e867e7fb reply state 000000007a1d8dd1 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.810835:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.810843:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833915.810846:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833915.810850:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833915.810942:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+42:11200:x1874679381925376:12345-192.168.203.17@tcp:36:dd.0 Request processed in 780us (1068us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787833915.810949:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000020:00080000:1.0:1787833915.810954:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1787833915.862592:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787833915.865190:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787833915.976323:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833915.976536:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381925504 00000100:00100000:1.0:1787833915.976545:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381925504 00000100:00100000:1.0:1787833915.976608:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:1.0:1787833915.976618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+42:11215:x1874679381925504:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:1.0:1787833915.976641:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833915.976661:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebd8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976730:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976776:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976788:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976809:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976817:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976825:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976898:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976908:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebca expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976917:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976949:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebca expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.976962:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebca expref: 43 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833915.976976:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406135680:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833915.977069:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.982910:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833915.983243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381925760 00000100:00100000:0.0:1787833915.983252:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381925760 00000100:00100000:0.0:1787833915.983323:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1787833915.983333:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+44:6173:x1874679381925760:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787833915.984015:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+45:6173:x1874679381925760:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 681us (1114us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787833915.984025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:1.0:1787833915.984196:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406135680:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833915.984232:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833915.988361:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833915.988659:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381925888 00000100:00100000:3.0:1787833915.988669:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381925888 00010000:00010000:3.0:1787833915.988711:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebca expref: 45 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833915.988838:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:3.0:1787833915.988848:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+45:2400:x1874679381925888:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833915.988863:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833915.988880:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebca expref: 45 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.988894:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebca expref: 45 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.988917:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d78c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebca expref: 45 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.988932:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:3.0:1787833915.988937:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.988946:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.988953:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.988986:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833915.989036:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+44:2400:x1874679381925888:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 190us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.989044:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00010000:00010000:1.0:1787833915.989690:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989700:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833915.989773:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787833915.989778:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833915.989822:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989836:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989846:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989852:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989859:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989878:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3bc00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833915.989883:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989890:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989901:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833915.989915:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833915.989921:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989927:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989941:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989947:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989953:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989958:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833915.989961:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989967:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989976:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df602ff4e00) 00010000:00010000:1.0:1787833915.989979:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833915.989982:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.989988:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.990019:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd8 expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.990045:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd8 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.990254:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833915.990266:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833915.990269:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a600, rc 0) 00000100:00100000:1.0:1787833915.990311:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+43:11215:x1874679381925504:12345-192.168.203.17@tcp:101:stat.0 Request processed in 13694us (13997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.990319:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:3.0:1787833916.039014:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.039185:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381926144 00000100:00100000:1.0:1787833916.039193:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381926144 00000100:00100000:1.0:1787833916.039279:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:1.0:1787833916.039289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+43:11222:x1874679381926144:12345-192.168.203.17@tcp:36:truncate.0 00010000:00010000:1.0:1787833916.039343:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1787833916.039352:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787833916.039369:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd8 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.039387:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833916.039390:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833916.039575:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.039589:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.039599:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833916.039647:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1787833916.039673:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061352a10 reply state 00000000982df276 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.039686:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.039693:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833916.039695:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833916.039698:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833916.039855:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+45:11222:x1874679381926144:12345-192.168.203.17@tcp:36:truncate.0 Request processed in 567us (847us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787833916.039863:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000020:00080000:1.0:1787833916.039869:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787833916.149439:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.149557:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381926272 00000100:00100000:1.0:1787833916.149567:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381926272 00000100:00100000:1.0:1787833916.149627:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:1.0:1787833916.149636:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+45:11236:x1874679381926272:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:1.0:1787833916.149656:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833916.149674:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebdf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150007:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150020:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150028:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150048:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150054:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150061:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150126:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150134:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150142:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833916.150181:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787833916.150185:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833916.150202:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150214:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150232:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150238:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150255:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150261:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.150265:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150273:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150284:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833916.150288:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833916.150292:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150299:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d7d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150309:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150313:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150317:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150319:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3bc00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.150321:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150332:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150338:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df602ff4e00) 00010000:00010000:1.0:1787833916.150339:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833916.150342:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150345:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d7e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150364:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebdf expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150438:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebdf expref: 46 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.150451:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833916.150453:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833916.150456:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ac00, rc 0) 00000100:00100000:1.0:1787833916.150555:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+46:11236:x1874679381926272:12345-192.168.203.17@tcp:101:stat.0 Request processed in 920us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833916.150563:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00010000:00010000:2.0:1787833916.182171:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833916.200959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.201079:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381926528 00000100:00100000:1.0:1787833916.201088:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381926528 00000100:00100000:1.0:1787833916.201185:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:1.0:1787833916.201197:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504485e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+46:11246:x1874679381926528:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833916.201243:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833916.201261:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebe6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833916.201359:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787833916.201452:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebe6 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.201466:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:1.0:1787833916.201469:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833916.201474:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebe6 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.201487:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a600, rc 0) 00000100:00100000:1.0:1787833916.201558:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504485e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+47:11246:x1874679381926528:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 364us (607us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1787833916.201565:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:3.0:1787833916.203356:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833916.203688:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381926784 00000100:00100000:2.0:1787833916.203698:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381926784 00000100:00100000:0.0:1787833916.203833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:0.0:1787833916.203858:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+47:11246:x1874679381926784:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1787833916.204062:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+48:11246:x1874679381926784:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 218us (710us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787833916.204070:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:0.0:1787833916.252001:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.252274:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381927040 00000100:00100000:1.0:1787833916.252339:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381927040 00000100:00100000:1.0:1787833916.252443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:1.0:1787833916.252466:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+48:11252:x1874679381927040:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833916.252490:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833916.252508:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.252630:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.252680:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebdf expref: 49 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.252690:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.252719:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebdf expref: 49 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.252734:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebdf expref: 49 pid: 6515 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833916.252822:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406135808:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833916.253003:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e73180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833916.259306:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406135808:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833916.259334:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833916.259392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.260724:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381927168 00000100:00100000:3.0:1787833916.260736:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381927168 00010000:00010000:3.0:1787833916.260800:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebdf expref: 50 pid: 6515 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833916.260861:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:3.0:1787833916.260871:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e166850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+50:2400:x1874679381927168:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833916.260887:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833916.260893:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebdf expref: 50 pid: 6515 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.260905:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebdf expref: 50 pid: 6515 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.260928:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d7e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebdf expref: 50 pid: 6515 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.260944:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:3.0:1787833916.260948:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.260958:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.260966:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.260997:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833916.261071:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e166850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+49:2400:x1874679381927168:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 201us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833916.261078:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00010000:00010000:1.0:1787833916.261156:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.261166:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833916.261185:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787833916.261333:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d7fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebed expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.261361:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebed expref: 49 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.261369:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833916.261371:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833916.261374:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3bc00, rc 0) 00000100:00100000:1.0:1787833916.261400:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+49:11252:x1874679381927040:12345-192.168.203.17@tcp:101:bash.0 Request processed in 8948us (9408us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787833916.261407:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:3.0:1787833916.264318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.264543:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381927424 00000100:00100000:1.0:1787833916.264552:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381927424 00000100:00100000:1.0:1787833916.264601:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:1.0:1787833916.264617:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+49:11252:x1874679381927424:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:1.0:1787833916.264843:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.264860:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.264873:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833916.264915:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1787833916.264938:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000812253d8 reply state 00000000226269f2 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.264951:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.264968:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833916.264971:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833916.264974:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833916.265205:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+52:11252:x1874679381927424:12345-192.168.203.17@tcp:36:bash.0 Request processed in 594us (894us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1787833916.265212:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00000020:00080000:1.0:1787833916.265226:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787833916.274531:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.274620:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381927552 00000100:00100000:1.0:1787833916.274629:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381927552 00000100:00100000:1.0:1787833916.274684:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:1.0:1787833916.274694:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+52:11252:x1874679381927552:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833916.274716:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833916.274734:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d818 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebf4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.274870:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.274885:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebed expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.274893:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.274922:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebed expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.274934:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebed expref: 53 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833916.274955:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406135936:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833916.275033:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e73180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833916.278182:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.278312:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381927680 00000100:00100000:3.0:1787833916.278321:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381927680 00010000:00010000:3.0:1787833916.278358:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebed expref: 54 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833916.278397:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:3.0:1787833916.278407:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504487840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+54:2401:x1874679381927680:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833916.278421:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833916.278428:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebed expref: 54 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.278441:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebed expref: 54 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.278463:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:3.0:1787833916.278469:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.278478:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.278485:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.278503:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833916.278661:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d803 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebed expref: 54 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833916.278678:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406135936:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833916.278697:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.278706:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.278711:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833916.278859:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504487840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+53:2401:x1874679381927680:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 453us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833916.278866:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000004:00200000:1.0:1787833916.278967:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787833916.278972:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833916.278992:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.279020:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d818 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebf4 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.279032:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebf4 expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.279039:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833916.279047:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833916.279050:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ac00, rc 0) 00000100:00100000:1.0:1787833916.279073:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+52:11252:x1874679381927552:12345-192.168.203.17@tcp:101:bash.0 Request processed in 4381us (4551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833916.279080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:3.0:1787833916.281981:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833916.282189:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381927936 00000100:00100000:2.0:1787833916.282198:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381927936 00000100:00100000:2.0:1787833916.282263:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:2.0:1787833916.282273:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df610442050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+52:11252:x1874679381927936:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:2.0:1787833916.283041:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df610442050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+53:11252:x1874679381927936:12345-192.168.203.17@tcp:35:bash.0 Request processed in 767us (1064us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787833916.283050:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:0.0:1787833916.354876:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.354973:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381928192 00000100:00100000:1.0:1787833916.354983:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381928192 00000100:00100000:1.0:1787833916.355047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:1.0:1787833916.355057:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+53:11262:x1874679381928192:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833916.355077:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833916.355094:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d826 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ebfb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833916.355196:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787833916.355291:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d826 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebfb expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.355305:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:1.0:1787833916.355307:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833916.355313:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d826 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebfb expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.355327:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a600, rc 0) 00000100:00100000:1.0:1787833916.355391:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+54:11262:x1874679381928192:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 336us (524us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1787833916.355399:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:3.0:1787833916.362177:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.362351:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381928320 00000100:00100000:1.0:1787833916.362373:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381928320 00000100:00100000:1.0:1787833916.362444:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:1.0:1787833916.362455:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+54:11262:x1874679381928320:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:1.0:1787833916.362540:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362557:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362568:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362579:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362585:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362592:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362670:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362678:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362686:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833916.362734:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362792:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362798:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362805:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362815:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.362818:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362826:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362838:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833916.362841:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833916.362846:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362851:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a600/0x996d2fb20dc1d834 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362864:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362870:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362876:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362887:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3bc00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.362890:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362896:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362904:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df602ff4e00) 00010000:00010000:1.0:1787833916.362906:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833916.362909:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362914:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1d83b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362922:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362928:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362933:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362939:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.362942:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362947:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362964:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833916.362966:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833916.362969:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.362975:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d842 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833916.363057:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+54:11262:x1874679381928320:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 604us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833916.363065:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:0.0:1787833916.367420:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.367501:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381928576 00000100:00100000:1.0:1787833916.367510:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381928576 00000100:00100000:1.0:1787833916.367567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:1.0:1787833916.367577:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+54:11262:x1874679381928576:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787833916.368035:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+55:11262:x1874679381928576:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 459us (623us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787833916.368044:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:0.0:1787833916.399002:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.399131:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381928832 00000100:00100000:1.0:1787833916.399139:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381928832 00000100:00100000:1.0:1787833916.399240:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:1.0:1787833916.399250:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+55:11265:x1874679381928832:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833916.399270:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833916.399289:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d849 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec02 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399361:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399385:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399395:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399405:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399411:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399416:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399511:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1d85e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399519:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1d85e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399525:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1d85e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833916.399535:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787833916.399617:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399625:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399631:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399643:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.399647:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399654:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399677:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833916.399680:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833916.399686:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399691:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1d850 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399706:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399712:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399717:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399722:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.399725:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399730:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399747:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df602ff4e00) 00010000:00010000:1.0:1787833916.399805:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833916.399808:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399814:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d857 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399854:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1d849 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec02 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399873:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1d85e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec02 expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.399880:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833916.399882:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833916.399884:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723800, rc 0) 00000100:00100000:1.0:1787833916.399950:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+57:11265:x1874679381928832:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 700us (954us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787833916.399958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:3.0:1787833916.402002:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.402050:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.402176:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381929088 00000100:00100000:1.0:1787833916.402185:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381929088 00000100:00100000:1.0:1787833916.402248:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:1.0:1787833916.402257:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+57:11265:x1874679381929088:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1787833916.402317:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.402339:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.402363:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.402393:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.402400:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.402407:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.402414:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.402418:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.402426:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.402437:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833916.402440:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833916.402444:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.402451:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1d86c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833916.402565:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+57:11265:x1874679381929088:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 308us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833916.402574:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:0.0:1787833916.402645:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381928960 00000100:00100000:0.0:1787833916.402650:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381928960 00000100:00100000:0.0:1787833916.402685:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1787833916.402846:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+57:2400:x1874679381928960:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833916.402860:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833916.402883:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1d85e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec02 expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.402895:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:0.0:1787833916.402898:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833916.402916:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+56:2400:x1874679381928960:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 225us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833916.402920:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1787833916.404685:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.404799:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381929344 00000100:00100000:1.0:1787833916.404823:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381929344 00000100:00100000:1.0:1787833916.404872:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1787833916.404880:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+56:11265:x1874679381929344:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787833916.405106:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+57:11265:x1874679381929344:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 226us (428us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787833916.405114:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:3.0:1787833916.469860:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.469906:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.470051:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.470094:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.470118:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.470349:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381929472 00000100:00100000:1.0:1787833916.470359:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381929472 00000100:00100000:1.0:1787833916.470416:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 385 00000100:00100000:1.0:1787833916.470427:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381929472:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833916.470496:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381929472:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 71us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833916.470504:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 385 00000100:00100000:1.0:1787833916.470602:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381929984 00000100:00100000:1.0:1787833916.470606:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381929984 00000100:00100000:1.0:1787833916.470636:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381929600 00000100:00100000:1.0:1787833916.470639:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381929600 00000100:00100000:1.0:1787833916.470663:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381929856 00000100:00100000:1.0:1787833916.470666:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381929856 00000100:00100000:1.0:1787833916.470686:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 299 00000100:00100000:1.0:1787833916.470693:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381929984:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833916.470722:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381929984:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 29us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833916.470728:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 299 00000100:00100000:1.0:1787833916.470740:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 300 00000100:00100000:1.0:1787833916.470746:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381929600:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833916.470873:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381929728 00000100:00100000:0.0:1787833916.470877:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381929728 00000100:00100000:0.0:1787833916.470912:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 111 00000100:00100000:0.0:1787833916.470930:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381929728:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833916.470963:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381929728:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 44us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833916.470969:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 111 00000100:00080000:0.0:1787833916.470987:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833916.470991:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833916.470993:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833916.471017:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 301 00000100:00100000:0.0:1787833916.471024:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381929856:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833916.471050:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381929856:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833916.471055:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 301 00000100:00100000:1.0:1787833916.473537:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381929600:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 2782us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833916.473551:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 300 00000100:00100000:3.0:1787833916.516542:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833916.516908:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381930240 00000100:00100000:0.0:1787833916.516917:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381930240 00000100:00100000:0.0:1787833916.517211:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:0.0:1787833916.517232:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+57:11283:x1874679381930240:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:0.0:1787833916.517268:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833916.517288:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d873 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec09 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.517389:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d87a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.517403:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d87a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.517413:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d87a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833916.517423:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787833916.517634:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d873 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec09 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.517652:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d87a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec09 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.517660:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:0.0:1787833916.517662:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787833916.517666:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7000, rc 0) 00000100:00100000:0.0:1787833916.517966:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11283:x1874679381930240:12345-192.168.203.17@tcp:101:cat.0 Request processed in 746us (1431us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787833916.517974:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:3.0:1787833916.552097:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833916.552230:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381930368 00000100:00100000:2.0:1787833916.552239:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381930368 00000100:00100000:2.0:1787833916.552352:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00100000:2.0:1787833916.552363:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11284:x1874679381930368:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833916.552387:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833916.552408:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d888 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.552476:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d88f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.552492:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d88f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.552504:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d88f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833916.552575:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787833916.552580:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833916.552601:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d88f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.552629:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1d888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec10 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.552647:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d88f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec10 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.552656:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:2.0:1787833916.552660:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833916.552675:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:2.0:1787833916.552733:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11284:x1874679381930368:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 366us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833916.552738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00100000:1.0:1787833916.561673:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833916.562932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381930752 00000100:00100000:2.0:1787833916.562946:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381930752 00000100:00100000:2.0:1787833916.563005:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1787833916.563015:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11284:x1874679381930752:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1787833916.563314:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11284:x1874679381930752:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 299us (1645us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787833916.563321:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1787833916.564966:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833916.565048:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381930880 00000100:00100000:2.0:1787833916.565057:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381930880 00000100:00100000:2.0:1787833916.565129:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:2.0:1787833916.565138:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11284:x1874679381930880:12345-192.168.203.17@tcp:103:lfs.0 00010000:00010000:2.0:1787833916.565152:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787833916.565177:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1d81f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebf4 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.565199:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1d87a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec09 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.565211:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1d71c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebae expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.565235:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:2.0:1787833916.565240:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833916.565289:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+58:11284:x1874679381930880:12345-192.168.203.17@tcp:103:lfs.0 Request processed in 152us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833916.565297:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1787833916.571021:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.571111:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381931008 00000100:00100000:1.0:1787833916.571121:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381931008 00000100:00100000:1.0:1787833916.571178:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:1.0:1787833916.571188:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+58:11284:x1874679381931008:12345-192.168.203.17@tcp:58:lfs.0 00010000:00010000:1.0:1787833916.571317:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.571333:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.571345:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787833916.571574:0:9772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833916.571710:0:9772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787833916.571850:0:9772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787833916.571934:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+58:11284:x1874679381931008:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 746us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833916.571943:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:1.0:1787833916.589982:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833916.590446:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381931136 00000100:00100000:0.0:1787833916.590456:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381931136 00000100:00100000:0.0:1787833916.590562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:0.0:1787833916.590586:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+58:11286:x1874679381931136:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833916.590606:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833916.590624:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d89d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec17 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590684:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590698:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590709:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590720:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590727:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590732:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590834:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590844:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590852:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833916.590904:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787833916.590909:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833916.590927:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590940:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590948:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590953:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590960:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590965:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833916.590969:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590977:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.590989:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833916.590992:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833916.590995:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591001:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1d8a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591022:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591027:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591032:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591037:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833916.591040:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591045:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591069:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df602ff4e00) 00010000:00010000:0.0:1787833916.591072:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833916.591075:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591081:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591107:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d89d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec17 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591120:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec17 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.591137:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:0.0:1787833916.591140:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833916.591142:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6600, rc 0) 00000100:00100000:0.0:1787833916.591203:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11286:x1874679381931136:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 619us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833916.591210:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 77 00000040:00080000:2.0:1787833916.886117:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833916.886126:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833916.886157:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787833916.886167:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833916.886301:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504487480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406136064:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787833916.886398:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787833916.892414:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504487480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406136064:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787833916.893459:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833916.893654:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381931264 00000100:00100000:2.0:1787833916.893661:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381931264 00000100:00100000:2.0:1787833916.893728:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:2.0:1787833916.893744:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504573c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11297:x1874679381931264:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787833916.894280:0:6515:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787833916.894388:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504573c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11297:x1874679381931264:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 645us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833916.894396:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:3.0:1787833916.900873:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833916.901095:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381931392 00000100:00100000:2.0:1787833916.901104:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381931392 00000100:00100000:2.0:1787833916.901168:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:2.0:1787833916.901179:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11297:x1874679381931392:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787833916.901255:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901271:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901284:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901330:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901339:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901346:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901373:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901395:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901402:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833916.901445:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787833916.901449:0:13407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833916.901460:0:13407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901472:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901479:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901485:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901491:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833916.901495:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901503:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901513:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:2.0:1787833916.901517:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833916.901521:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901538:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1d8b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901550:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901556:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901562:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901567:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833916.901570:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901576:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901584:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8df6032d9400) 00010000:00010000:2.0:1787833916.901586:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833916.901589:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901595:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1d8c0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901609:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901615:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901627:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901631:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833916.901634:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901639:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901647:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:2.0:1787833916.901649:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833916.901651:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833916.901657:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1d8c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833916.901731:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11297:x1874679381931392:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 554us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833916.901739:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:3.0:1787833916.903903:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833916.904002:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381931648 00000100:00100000:0.0:1787833916.904010:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381931648 00000100:00100000:0.0:1787833916.904069:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:0.0:1787833916.904088:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11297:x1874679381931648:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833916.904106:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833916.904125:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d8ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec1e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904230:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904244:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904256:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833916.904267:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787833916.904341:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904348:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904366:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904371:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833916.904375:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904384:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904394:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:0.0:1787833916.904397:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833916.904401:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904408:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904448:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d8ce lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec1e expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904458:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:0.0:1787833916.904460:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787833916.904464:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d8ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec1e expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.904473:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7800, rc 0) 00000100:00100000:0.0:1787833916.904537:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11297:x1874679381931648:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 451us (642us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1787833916.904555:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:3.0:1787833916.911598:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833916.912341:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381931776 00000100:00100000:2.0:1787833916.912396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381931776 00000100:00100000:2.0:1787833916.912463:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 81 00000100:00100000:2.0:1787833916.912474:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11297:x1874679381931776:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787833916.912507:0:6515:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787833916.912618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11297:x1874679381931776:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 147us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833916.912636:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 81 00000100:00100000:1.0:1787833916.916454:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833916.916532:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381932032 00000100:00100000:0.0:1787833916.916541:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381932032 00000100:00100000:0.0:1787833916.916744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:0.0:1787833916.917995:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11297:x1874679381932032:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833916.918018:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833916.918021:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787833916.918048:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1d88f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec10 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.918064:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833916.918068:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833916.918080:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d8e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec25 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787833916.918423:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787833916.918535:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.918547:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.918556:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.919158:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1d8e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec25 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.919191:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec25 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833916.919199:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df503f02f00) 00010000:00010000:0.0:1787833916.919202:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833916.919205:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7200, rc 0) 00000100:00100000:0.0:1787833916.919302:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11297:x1874679381932032:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1323us (2857us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787833916.919311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:2.0:1787833916.929448:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833916.930709:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381932288 00000100:00100000:1.0:1787833916.930721:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381932288 00000100:00100000:1.0:1787833916.930817:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:1.0:1787833916.930828:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11297:x1874679381932288:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787833916.930898:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833916.931048:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1d8ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec25 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931066:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df503f02f00) 00010000:00010000:1.0:1787833916.931145:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833916.931169:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931183:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931195:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931262:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931271:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931279:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931327:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931335:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931343:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931357:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.931361:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931370:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931380:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833916.931382:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833916.931387:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931394:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1d8f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931405:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931412:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931419:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931426:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833916.931429:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931435:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931453:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xab7c5e8d (ffff8df503f0e800) 00010000:00010000:1.0:1787833916.931456:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833916.931459:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.931465:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1d8ff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xab7c5e8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833916.931549:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11297:x1874679381932288:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 723us (2111us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787833916.931558:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:1.0:1787833916.937807:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.937886:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381932416 00000100:00100000:3.0:1787833916.937896:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381932416 00000100:00100000:3.0:1787833916.937961:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:3.0:1787833916.937971:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11297:x1874679381932416:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833916.937991:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833916.938012:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d906 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec2c expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.938058:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.938186:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.938198:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.938314:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d906 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec2c expref: 62 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.938331:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec2c expref: 61 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.938339:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:3.0:1787833916.938342:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787833916.938345:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031000, rc 0) 00000100:00100000:3.0:1787833916.938411:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11297:x1874679381932416:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 441us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833916.938419:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:0.0:1787833916.946257:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.947316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381932672 00000100:00100000:3.0:1787833916.947326:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381932672 00000100:00100000:3.0:1787833916.947381:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:3.0:1787833916.947390:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11297:x1874679381932672:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787833916.947463:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.947491:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.947503:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833916.947655:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787833916.947666:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392860914071ns, next at 393860912256ns, rc = 0 00000004:00010000:3.0:1787833916.947710:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000888e3504 reply state 000000002b9871a5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.947723:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.947829:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:3.0:1787833916.947833:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787833916.947837:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833916.948002:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+63:11297:x1874679381932672:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 611us (1752us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787833916.948010:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:1.0:1787833916.957275:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.957340:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381932800 00000100:00100000:3.0:1787833916.957349:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381932800 00000100:00100000:3.0:1787833916.957406:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:3.0:1787833916.957415:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+63:11297:x1874679381932800:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833916.957434:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833916.957451:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec33 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.957518:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec33 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.957532:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec33 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.957547:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:3.0:1787833916.957550:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833916.957554:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030600, rc 0) 00000100:00100000:3.0:1787833916.957610:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+64:11297:x1874679381932800:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 197us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833916.957617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:0.0:1787833916.969196:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.969270:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381932928 00000100:00100000:3.0:1787833916.969279:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381932928 00000100:00100000:3.0:1787833916.969324:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:3.0:1787833916.969332:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1874679381932928:12345-192.168.203.17@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787833916.969364:0:8431:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:3.0:1787833916.969392:0:8431:0:(genops.c:1385:class_connect()) connect: client a4724ace-a769-4adb-acca-a2bfbc389c92, cookie 0x996d2fb20dc1d922 00002000:00100000:3.0:1787833916.969403:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a4724ace-a769-4adb-acca-a2bfbc389c92/ffff8df50474a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787833916.969412:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787833916.969483:0:8431:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787833916.969510:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8df50474d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833916.969579:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2397:x1874679381932928:12345-192.168.203.17@tcp:8:lhsmtool_posix.0 Request processed in 247us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833916.969600:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:0.0:1787833916.974595:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.974890:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381933056 00000100:00100000:3.0:1787833916.974899:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381933056 00000100:00100000:3.0:1787833916.974965:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:3.0:1787833916.974976:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:0:x1874679381933056:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787833916.975298:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787833916.976430:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1787833916.976441:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000100:00100000:0.0:1787833916.976614:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+5:0:x1874679381933056:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 1636us (2024us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787833916.976624:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:1.0:1787833916.982898:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.985926:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381933312 00000100:00100000:3.0:1787833916.985942:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381933312 00000100:00100000:1.0:1787833916.988039:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:1.0:1787833916.988054:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+64:11297:x1874679381933312:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787833916.989549:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+65:11297:x1874679381933312:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 1494us (6655us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1787833916.989561:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:0.0:1787833916.995138:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833916.998913:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381933568 00000100:00100000:3.0:1787833916.998927:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381933568 00000100:00100000:3.0:1787833916.999002:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00100000:3.0:1787833916.999014:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+65:11297:x1874679381933568:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787833916.999136:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+65:11297:x1874679381933568:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 124us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833916.999143:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00100000:1.0:1787833917.020659:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.023005:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381933696 00000100:00100000:3.0:1787833917.023018:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381933696 00000100:00100000:3.0:1787833917.025305:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:3.0:1787833917.025322:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+65:11297:x1874679381933696:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833917.025343:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833917.025363:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d929 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec3a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.025427:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d930 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.025447:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.025458:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833917.025499:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787833917.025516:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.025540:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1d929 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec3a expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.025555:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d930 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec3a expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.025564:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:3.0:1787833917.025567:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787833917.025570:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fd800, rc 0) 00000100:00100000:3.0:1787833917.025639:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+66:11297:x1874679381933696:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 323us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.025646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:2.0:1787833917.031667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.031730:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381933824 00000100:00100000:3.0:1787833917.031740:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381933824 00000100:00100000:3.0:1787833917.031827:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:3.0:1787833917.031837:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504485680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381933824:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833917.031855:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833917.031882:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec41 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833917.031907:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902e3d, blocks: 0x0 00010000:00010000:3.0:1787833917.031926:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=392s v=(0 0) 00010000:00010000:3.0:1787833917.031931:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833917.031940:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec41 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.031958:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec41 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.031972:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fda00, rc 0) 00000100:00100000:3.0:1787833917.032025:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504485680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381933824:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 189us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.032033:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:0.0:1787833917.036144:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.036279:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381934080 00000100:00100000:3.0:1787833917.036289:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381934080 00000100:00100000:3.0:1787833917.036351:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 89 00000100:00100000:3.0:1787833917.036361:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+66:11297:x1874679381934080:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787833917.036459:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+66:11297:x1874679381934080:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.036467:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 89 00000100:00100000:3.0:1787833917.039134:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.039273:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381934208 00000100:00100000:0.0:1787833917.039280:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381934208 00000100:00100000:0.0:1787833917.039323:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:0.0:1787833917.039332:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:11297:x1874679381934208:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833917.039350:0:8583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833917.039366:0:8583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec48 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.039405:0:8583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec41 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.039414:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833917.039418:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833917.039423:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 7 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.039454:0:8583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec41 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.039466:0:8583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec41 expref: 7 pid: 8431 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.039479:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8583:1874679406136192:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833917.039570:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833917.045351:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8583:1874679406136192:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833917.045389:0:8583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 7 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.045410:0:8583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7800, rc 0) 00000100:00100000:0.0:1787833917.045468:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:11297:x1874679381934208:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 6137us (6341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833917.045477:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:3.0:1787833917.045849:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.045899:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381934336 00000100:00100000:1.0:1787833917.045908:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381934336 00010000:00010000:1.0:1787833917.045955:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec41 expref: 7 pid: 8431 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.045993:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:1.0:1787833917.046011:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504617840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2401:x1874679381934336:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833917.046027:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833917.046049:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec41 expref: 7 pid: 8431 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.046062:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec41 expref: 7 pid: 8431 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.046087:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e0ca524/0x996d2fb20dc1d937 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec41 expref: 7 pid: 8431 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.046103:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833917.046107:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833917.046114:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 6 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.046124:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 6 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.046157:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 6 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.046172:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1874679406136320:192.168.203.17@tcp:105: 00000100:00100000:1.0:1787833917.046266:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e73600 going to sleep for 11 seconds 00000100:00100000:1.0:1787833917.048341:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1874679406136320:192.168.203.17@tcp:105: 00010000:00010000:1.0:1787833917.048376:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833917.048438:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504617840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381934336:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 2427us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.048449:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:0.0:1787833917.049861:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.049915:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381934464 00000100:00100000:1.0:1787833917.049933:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381934464 00002000:00100000:1.0:1787833917.049978:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8df63fcb2940 x1874679381934464/t0(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:723/0 lens 504/0 e 0 to 0 dl 1787833928 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787833917.049989:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df63fcb2940 with x1874679381934464 ext(0->8) 00002000:00010000:1.0:1787833917.049994:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df63fcb2940 00000100:00100000:1.0:1787833917.050024:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1787833917.050034:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2398:x1874679381934464:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787833917.050701:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2398:x1874679381934464:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 Request processed in 665us (950us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787833917.050711:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00002000:00100000:1.0:1787833917.050718:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8df63fcb2940 x1874679381934464/t4294967303(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:723/0 lens 504/448 e 0 to 0 dl 1787833928 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787833917.050726:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df63fcb2940 with x1874679381934464 ext(0->8) 00002000:00010000:1.0:1787833917.050731:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df63fcb2940 00000100:00100000:3.0:1787833917.053391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.053936:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381934592 00000100:00100000:0.0:1787833917.053945:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381934592 00000100:00100000:0.0:1787833917.053991:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00100000:0.0:1787833917.054000:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504615e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+66:11297:x1874679381934592:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787833917.061387:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1787833917.061406:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1787833917.061476:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787833917.061490:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df63b1a8a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787833917.061496:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df502441100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df63b1a8540 00000020:00080000:0.0:1787833917.061499:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df502441800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df618600200 00000100:00100000:0.0:1787833917.061622:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833917.061641:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406136448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787833917.061707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833917.061868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504615e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+20:11297:x1874679381934592:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 7865us (8484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833917.061878:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 90 00010000:00010000:1.0:1787833917.063014:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063029:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063036:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063058:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.063073:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063082:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063099:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8df602ff4300) 00010000:00010000:1.0:1787833917.063102:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.063107:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063113:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1d658 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063135:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063141:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063147:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063152:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.063154:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063160:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063179:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833917.063186:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.063189:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063195:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1d65f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063211:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063227:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063233:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063238:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.063240:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063246:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063253:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df602ff4e00) 00010000:00010000:1.0:1787833917.063255:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.063258:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063263:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1d69e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063288:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063295:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063300:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063304:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.063307:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063313:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063320:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833917.063322:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.063325:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063330:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1d7a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063342:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063352:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063358:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063369:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3be00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.063373:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063378:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063386:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833917.063388:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.063390:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063395:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1d7cb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063406:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063411:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063416:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063420:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.063423:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063428:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063445:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833917.063447:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.063450:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063455:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a000/0x996d2fb20dc1d811 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063467:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063474:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063480:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063485:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.063488:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063494:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063501:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:1.0:1787833917.063503:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787833917.063506:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.063512:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1d914 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.063622:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833917.063637:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406136576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787833917.063691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833917.063744:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406136448 00000100:00100000:1.0:1787833917.063767:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406136448 00000100:00100000:1.0:1787833917.063818:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406136576 00000100:00100000:1.0:1787833917.063821:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406136576 00000100:00100000:1.0:1787833917.063844:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787833917.063853:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406136448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787833917.063964:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787833917.063968:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787833917 00002000:00010000:1.0:1787833917.063970:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787833917.063972:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787833917 -> 1787833917 00002000:00010000:1.0:1787833917.063974:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787833917.064011:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406136448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (2303us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787833917.064018:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787833917.064032:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787833917.064038:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406136576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787833917.064050:0:8430:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1787833917.064072:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a902e3b, atime: 0x6a902e3b, ctime: 0x6a902e3b, blocks: 0x8 00010000:00010000:1.0:1787833917.064078:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064092:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787833917.064095:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833917.064108:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064122:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064131:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064138:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064154:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787833917.064255:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1874679406136576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 217us (563us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787833917.064261:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787833917.064278:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833917.064282:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787833917.064288:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833917.064294:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064302:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787833917.064306:0:7455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064315:0:7455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064333:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064341:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1d945 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.064355:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833917.064357:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833917.064358:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787833917.064385:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df5045a9680/2, rc 0, transno 4294967302 00000100:00100000:1.0:1787833917.064390:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406136576:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787833917.064411:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df63fcb0780/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787833917.064416:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406136448:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787833917.064944:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1787833917.065162:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000020:00080000:3.0:1787833917.065233:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787833917.065252:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381934720 00000100:00100000:3.0:1787833917.065258:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381934720 00000100:00100000:3.0:1787833917.065326:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:3.0:1787833917.065335:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2401:x1874679381934720:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787833917.069326:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787833917.069339:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1787833917.069485:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381934720:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 4145us (4319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833917.069497:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:2.0:1787833917.072263:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.072343:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381934976 00000100:00100000:3.0:1787833917.072353:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381934976 00000100:00100000:3.0:1787833917.072413:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 91 00000100:00100000:3.0:1787833917.072423:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+14:11297:x1874679381934976:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787833917.072472:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833917.072498:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d930 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec3a expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.072517:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:3.0:1787833917.072522:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833917.072549:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.072562:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.072573:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833917.072692:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082c56e57 reply state 00000000ed76959e transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.072721:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.072727:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:3.0:1787833917.072730:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787833917.072733:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833917.073004:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+15:11297:x1874679381934976:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 582us (748us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1787833917.073012:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 91 00000100:00100000:3.0:1787833917.075171:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.075306:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381935104 00000100:00100000:1.0:1787833917.075317:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381935104 00000100:00100000:1.0:1787833917.075378:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:1.0:1787833917.075388:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504614b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381935104:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787833917.075548:0:8583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787833917.075552:0:8583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787833917 -> 1787833916 00002000:00010000:1.0:1787833917.075555:0:8583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787833915 00002000:00010000:1.0:1787833917.075557:0:8583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787833917 -> 1787833916 00002000:00010000:1.0:1787833917.075559:0:8583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787833917.075628:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504614b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381935104:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 241us (466us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787833917.075653:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:0.0:1787833917.077847:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.078172:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381935360 00000100:00100000:3.0:1787833917.078181:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381935360 00000100:00100000:3.0:1787833917.078242:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:3.0:1787833917.078251:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+15:11297:x1874679381935360:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787833917.078320:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.078338:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec2c expref: 15 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.078349:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.078383:0:13407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec2c expref: 15 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.078397:0:13407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec2c expref: 15 pid: 13407 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.078413:0:13407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406136704:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833917.078502:0:13407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612e60600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833917.080821:0:13407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406136704:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833917.080847:0:13407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.082684:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833917.082881:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381935488 00000100:00100000:2.0:1787833917.082890:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381935488 00010000:00010000:2.0:1787833917.082924:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec2c expref: 16 pid: 13407 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833917.082954:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:2.0:1787833917.082960:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504785a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+16:2401:x1874679381935488:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833917.082973:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833917.082977:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec2c expref: 16 pid: 13407 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.082986:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec2c expref: 16 pid: 13407 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.083004:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1d90d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec2c expref: 16 pid: 13407 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.083018:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:2.0:1787833917.083021:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.083036:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.083042:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.083069:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833917.083188:0:13407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.083196:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.083247:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.083254:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.083260:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.083266:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fd800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833917.083270:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.083278:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.083287:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:0.0:1787833917.083290:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787833917.083294:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.083299:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d953 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833917.083358:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504785a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+15:2401:x1874679381935488:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 396us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833917.083366:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:0.0:1787833917.085529:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+14:11297:x1874679381935360:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 Request processed in 7268us (7679us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787833917.085543:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:2.0:1787833917.087170:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.087341:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381935616 00000100:00100000:0.0:1787833917.087351:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381935616 00000100:00100000:0.0:1787833917.087402:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:0.0:1787833917.087426:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381935616:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787833917.087470:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.087489:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 7 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.087497:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833917.087502:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833917.087506:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.087538:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 7 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.087552:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 7 pid: 8583 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.087566:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1874679406136832:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833917.087643:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833917.093163:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1874679406136832:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833917.093196:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833917.094684:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.094883:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381935744 00000100:00100000:3.0:1787833917.094892:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381935744 00010000:00010000:3.0:1787833917.094933:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 8 pid: 8583 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.095012:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:3.0:1787833917.095023:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504487c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2401:x1874679381935744:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833917.095040:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833917.095073:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 8 pid: 8583 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.095087:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 8 pid: 8583 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.095110:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000540a5948/0x996d2fb20dc1d93e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec48 expref: 8 pid: 8583 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.095127:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1787833917.095131:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833917.095137:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.095147:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.095190:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833917.095253:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504487c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2401:x1874679381935744:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 232us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.095261:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00010000:00010000:0.0:1787833917.095308:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.095325:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.095345:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.095353:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.095362:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.095369:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787833917.095372:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.095380:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.095392:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.095400:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e654f94/0x996d2fb20dc1d95a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.095456:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381935616:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 8033us (8293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833917.095465:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:1.0:1787833917.098130:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.098245:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381936000 00000100:00100000:0.0:1787833917.098255:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381936000 00000100:00100000:0.0:1787833917.098311:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:0.0:1787833917.098320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+14:11297:x1874679381936000:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787833917.098416:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.098432:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd1 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.098441:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.098471:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd1 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.098484:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd1 expref: 14 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.098497:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406136960:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833917.098575:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787833917.100976:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.101038:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381936128 00000100:00100000:3.0:1787833917.101046:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381936128 00010000:00010000:3.0:1787833917.101091:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd1 expref: 15 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.101123:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:3.0:1787833917.101131:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e167050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+15:2400:x1874679381936128:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833917.101144:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833917.101150:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd1 expref: 15 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.101162:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd1 expref: 15 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.101185:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:3.0:1787833917.101190:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.101200:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.101218:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.101251:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833917.101301:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e167050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+15:2400:x1874679381936128:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 170us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.101308:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00010000:00010000:0.0:1787833917.101609:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3aa00/0x996d2fb20dc1d7a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ebd1 expref: 14 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.101635:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406136960:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833917.101651:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.101660:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.101666:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.101841:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.101852:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec33 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.101860:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.101882:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec33 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.101894:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec33 expref: 14 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.101905:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406137088:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833917.101956:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833917.104619:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406137088:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833917.104660:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.105151:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833917.105208:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381936256 00000100:00100000:2.0:1787833917.105223:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381936256 00010000:00010000:2.0:1787833917.105258:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec33 expref: 15 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833917.105293:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:2.0:1787833917.105302:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+15:2400:x1874679381936256:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833917.105316:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833917.105322:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec33 expref: 15 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.105335:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec33 expref: 15 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.105369:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1d91b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec33 expref: 15 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.105386:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:2.0:1787833917.105391:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.105400:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.105408:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.105434:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833917.105489:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+14:2400:x1874679381936256:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 187us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833917.105496:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00010000:00010000:0.0:1787833917.105641:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.105648:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833917.105793:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1787833917.105900:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1787833917.105933:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1787833917.106004:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1874679406137216:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787833917.106050:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833917.106072:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833917.106126:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406137216 00000100:00100000:1.0:1787833917.106131:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406137216 00000100:00100000:1.0:1787833917.106164:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787833917.106172:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504786580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1874679406137216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787833917.106257:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504786580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1874679406137216:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.106264:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787833917.106327:0:6514:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787833917.106332:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df63fcb0780, transno 4294967304 00000100:00100000:0.0:1787833917.106433:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1874679406137216:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787833917.106538:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1787833917.106574:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1874679406137344:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787833917.106602:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833917.106626:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833917.106933:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406137344 00000100:00100000:2.0:1787833917.106938:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406137344 00000100:00100000:2.0:1787833917.106971:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787833917.106978:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504785680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1874679406137344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787833917.107093:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504785680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1874679406137344:12345-0@lo:1000:mdt00_001.0 Request processed in 116us (490us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787833917.107101:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787833917.107168:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1874679406137344:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787833917.107199:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107207:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107224:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107230:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.107234:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107241:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107254:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:3.0:1787833917.107257:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833917.107261:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107268:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1d968 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107299:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107318:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107324:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107329:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.107332:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107339:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107348:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:3.0:1787833917.107350:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833917.107353:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107359:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1d896 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107382:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107395:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec17 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107403:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107428:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec17 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.107446:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec17 expref: 17 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.107457:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504617840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406137472:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833917.107516:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833917.122708:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.122786:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381936384 00000100:00100000:1.0:1787833917.122794:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381936384 00010000:00010000:1.0:1787833917.122836:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec17 expref: 18 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.122873:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:1.0:1787833917.122884:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+18:2400:x1874679381936384:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833917.122900:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833917.122908:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec17 expref: 18 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.122922:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec17 expref: 18 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.122945:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:1.0:1787833917.122960:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.122972:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.122980:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.123001:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833917.123048:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+18:2400:x1874679381936384:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 166us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.123055:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00010000:00010000:3.0:1787833917.123690:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1d8b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec17 expref: 17 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.123709:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504617840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406137472:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833917.123730:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123738:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123743:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123771:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123789:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123796:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123802:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fd800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.123816:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123823:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123833:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:3.0:1787833917.123836:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833917.123840:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123847:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d96f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123859:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123867:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123872:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123877:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.123880:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123886:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123894:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f0e200) 00010000:00010000:3.0:1787833917.123896:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787833917.123905:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.123911:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1d961 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.124079:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+16:11297:x1874679381936000:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 25759us (25957us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787833917.124087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 93 00000020:00080000:3.0:1787833917.124092:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787833917.124851:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833917.124857:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833917.124886:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787833917.124894:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833917.128100:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.128176:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381936640 00000100:00100000:3.0:1787833917.128185:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381936640 00000100:00100000:3.0:1787833917.128244:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1787833917.128253:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+16:11297:x1874679381936640:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787833917.128704:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787833917.128738:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787833917.128799:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.128815:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.128826:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.128834:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.128842:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.128848:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.128876:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787833917.128960:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+18:11297:x1874679381936640:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 707us (867us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787833917.128968:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000020:00080000:3.0:1787833917.128972:0:6517:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787833917.129170:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833917.129177:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.129184:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fda00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787833917.129188:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.129196:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.129208:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:1.0:1787833917.129219:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787833917.129232:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.129238:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d976 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.129252:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833917.129253:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833917.129255:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833917.206188:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787833917.226122:0:14208:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833917.226131:0:14208:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787833917.226153:0:14208:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787833917.226161:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833917.305854:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.306168:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381936896 00000100:00100000:1.0:1787833917.306179:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381936896 00000100:00100000:1.0:1787833917.306244:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:1.0:1787833917.306255:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504617840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+18:11307:x1874679381936896:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833917.306280:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833917.306302:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1d97d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec4f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.306416:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1d984 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.306432:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1d984 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.306444:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1d984 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833917.306455:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787833917.306629:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1d97d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec4f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.306646:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1d984 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec4f expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.306662:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833917.306665:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833917.306669:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723e00, rc 0) 00000100:00100000:1.0:1787833917.306732:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504617840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+20:11307:x1874679381936896:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 478us (887us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787833917.306739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:1.0:1787833917.310250:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.310813:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381937024 00000100:00100000:0.0:1787833917.310824:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381937024 00000100:00100000:0.0:1787833917.310887:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00100000:0.0:1787833917.310904:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+20:11307:x1874679381937024:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:0.0:1787833917.310975:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.310991:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311003:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311017:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311025:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311031:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311104:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311112:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311118:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833917.311160:0:13407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311172:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311183:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311189:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311195:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833917.311199:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311207:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311231:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833917.311234:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833917.311239:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311245:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d992 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311256:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311262:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311268:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311273:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833917.311281:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311288:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311296:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f02900) 00010000:00010000:0.0:1787833917.311299:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833917.311302:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311308:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d999 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311321:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311327:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311333:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311338:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833917.311340:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311346:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311352:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02500) 00010000:00010000:0.0:1787833917.311354:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833917.311361:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.311367:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.311434:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+20:11307:x1874679381937024:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 532us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833917.311442:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00100000:3.0:1787833917.355090:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.355387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381937280 00000100:00100000:0.0:1787833917.355397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381937280 00000100:00100000:0.0:1787833917.355460:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 96 00000100:00100000:0.0:1787833917.355469:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+20:11310:x1874679381937280:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833917.355488:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833917.355506:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec56 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356048:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356064:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356075:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356091:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356098:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356123:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356242:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356251:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356620:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833917.356633:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787833917.356713:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356721:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356727:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.356734:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833917.356746:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357104:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357116:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833917.357119:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833917.357132:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357138:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357152:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357158:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357164:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357169:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833917.357172:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357177:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357185:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f02500) 00010000:00010000:0.0:1787833917.357187:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833917.357190:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357195:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357247:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1d9a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec56 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357543:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec56 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.357550:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:0.0:1787833917.357553:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833917.357555:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247400, rc 0) 00000100:00100000:0.0:1787833917.357627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11310:x1874679381937280:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 2158us (2547us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787833917.357635:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 96 00000100:00100000:3.0:1787833917.363875:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.363967:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381937408 00000100:00100000:1.0:1787833917.363977:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381937408 00000100:00100000:1.0:1787833917.364045:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:1.0:1787833917.364066:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11310:x1874679381937408:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1787833917.364139:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.364156:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.364166:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.364204:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.364220:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.364227:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.364252:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.364257:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.364264:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.364278:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:1.0:1787833917.364281:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833917.364285:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.364291:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1d9ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.364370:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11310:x1874679381937408:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 316us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.364378:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:1.0:1787833917.369328:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.369415:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381937664 00000100:00100000:3.0:1787833917.369424:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381937664 00000100:00100000:3.0:1787833917.369495:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:3.0:1787833917.369507:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df610441c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11310:x1874679381937664:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787833917.369726:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df610441c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+23:11310:x1874679381937664:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 221us (408us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787833917.369735:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:1.0:1787833917.395728:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.395896:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381937920 00000100:00100000:3.0:1787833917.395906:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381937920 00000100:00100000:3.0:1787833917.395964:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00100000:3.0:1787833917.395976:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+23:10834:x1874679381937920:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833917.395999:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833917.396019:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d9d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec5d expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.396117:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.396145:0:9772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec56 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.396155:0:9772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.396184:0:9772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec56 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.396196:0:9772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec56 expref: 24 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.396220:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504614f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406137600:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833917.396319:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6053dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833917.401395:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504614f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406137600:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833917.401426:0:9772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.403911:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833917.404010:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381938048 00000100:00100000:2.0:1787833917.404021:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381938048 00010000:00010000:2.0:1787833917.404060:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec56 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833917.404118:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:2.0:1787833917.404128:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+25:2401:x1874679381938048:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833917.404143:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833917.404151:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec56 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.404163:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec56 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.404184:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1d9bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec56 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.404200:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:2.0:1787833917.404206:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.404229:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.404237:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.404281:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833917.404313:0:9772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.404323:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833917.404345:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000100:00100000:2.0:1787833917.404351:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+24:2401:x1874679381938048:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 222us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833917.404360:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00010000:00010000:1.0:1787833917.404490:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d9d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec5d expref: 25 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.404521:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec5d expref: 24 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.404528:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:1.0:1787833917.404531:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833917.404533:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fda00, rc 0) 00000100:00100000:1.0:1787833917.404565:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+24:10834:x1874679381937920:12345-192.168.203.17@tcp:101:bash.0 Request processed in 8592us (8846us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1787833917.404572:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00100000:1.0:1787833917.406667:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.406800:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381938176 00000100:00100000:0.0:1787833917.406811:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381938176 00000100:00100000:0.0:1787833917.406908:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 99 00000100:00100000:0.0:1787833917.406917:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+24:10834:x1874679381938176:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1787833917.406940:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833917.406963:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec64 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.406996:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.407009:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.407019:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.407255:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1d9e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec64 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.407281:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec64 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.407288:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:0.0:1787833917.407291:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787833917.407295:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247e00, rc 0) 00000100:00100000:0.0:1787833917.407382:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+25:10834:x1874679381938176:12345-192.168.203.17@tcp:101:bash.0 Request processed in 466us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833917.407433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 99 00000100:00100000:2.0:1787833917.409656:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.409815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381938432 00000100:00100000:1.0:1787833917.409824:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381938432 00000100:00100000:1.0:1787833917.409878:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00100000:1.0:1787833917.409888:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504487c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+25:10834:x1874679381938432:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:1.0:1787833917.410119:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.410136:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.410146:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833917.410186:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1787833917.410207:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abc40184 reply state 0000000090c4db41 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.410250:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.410261:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:1.0:1787833917.410265:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833917.410269:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787833917.410308:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1787833917.411055:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504487c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+29:10834:x1874679381938432:12345-192.168.203.17@tcp:36:bash.0 Request processed in 1165us (1547us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787833917.411065:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 100 00000020:00080000:1.0:1787833917.411070:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787833917.413488:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.413572:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381938560 00000100:00100000:3.0:1787833917.413581:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381938560 00000100:00100000:3.0:1787833917.413636:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:3.0:1787833917.413647:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+29:10834:x1874679381938560:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833917.413670:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833917.413690:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d9fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec6b expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.413747:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d9fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec6b expref: 30 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.413821:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d9fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec6b expref: 30 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.413842:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:3.0:1787833917.413846:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833917.413849:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fd800, rc 0) 00000100:00100000:3.0:1787833917.413899:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+30:10834:x1874679381938560:12345-192.168.203.17@tcp:101:bash.0 Request processed in 254us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.413906:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:2.0:1787833917.416535:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.416594:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381938688 00000100:00100000:3.0:1787833917.416604:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381938688 00000100:00100000:3.0:1787833917.416669:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:3.0:1787833917.416679:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:10834:x1874679381938688:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833917.416697:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833917.416717:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833917.416739:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a902e3c, atime: 0x6a902e3b, ctime: 0x6a902e3c, blocks: 0x8 00010000:00010000:3.0:1787833917.416777:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787833917.416782:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833917.416790:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec72 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.416805:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec72 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.416833:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6600, rc 0) 00000100:00100000:3.0:1787833917.416883:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:10834:x1874679381938688:12345-192.168.203.17@tcp:101:bash.0 Request processed in 206us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.416891:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:2.0:1787833917.418373:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.422075:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381938816 00000100:00100000:0.0:1787833917.422091:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381938816 00002000:00010000:0.0:1787833917.422139:0:8435:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1787833917.422144:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df5044843c0 with x1874679381938816 ext(0->18446744073709551615) 00002000:00010000:0.0:1787833917.422156:0:8435:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df5044843c0. 00000100:00100000:0.0:1787833917.422207:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:0.0:1787833917.422228:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2399:x1874679381938816:12345-192.168.203.17@tcp:10:bash.0 00002000:00010000:0.0:1787833917.423860:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787833917.423871:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787833916 -> 1787833917 00002000:00010000:0.0:1787833917.423875:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787833915 -> 1787833915 00002000:00010000:0.0:1787833917.423877:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787833916 -> 1787833917 00002000:00010000:0.0:1787833917.423879:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787833917.423966:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2399:x1874679381938816:12345-192.168.203.17@tcp:10:bash.0 Request processed in 1736us (5594us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787833917.423981:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00002000:00010000:0.0:1787833917.423998:0:8435:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1787833917.424002:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df5044843c0 with x1874679381938816 ext(0->18446744073709551615) 00002000:00010000:0.0:1787833917.424010:0:8435:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df5044843c0. 00000100:00100000:1.0:1787833917.460972:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.461061:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381938944 00000100:00100000:0.0:1787833917.461071:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381938944 00000100:00100000:3.0:1787833917.462326:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:3.0:1787833917.462345:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+30:11324:x1874679381938944:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:3.0:1787833917.462423:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462441:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462452:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462469:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462477:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462483:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462554:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462564:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462583:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833917.462628:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462639:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462645:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462651:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462657:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.462662:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462669:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462680:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:3.0:1787833917.462683:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833917.462688:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462694:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462707:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462719:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462725:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462729:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.462732:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462738:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462747:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df502d22600) 00010000:00010000:3.0:1787833917.462789:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833917.462793:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462800:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462817:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462823:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462828:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462833:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.462842:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462848:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462857:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:3.0:1787833917.462860:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833917.462862:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.462868:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.462948:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+30:11324:x1874679381938944:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 609us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.462955:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:2.0:1787833917.490456:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.490563:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381939200 00000100:00100000:1.0:1787833917.490571:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381939200 00000100:00100000:1.0:1787833917.490651:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 103 00000100:00100000:1.0:1787833917.490662:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504487840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+30:11327:x1874679381939200:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833917.490682:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833917.490702:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec79 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.490862:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.490876:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.490887:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.490921:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.490929:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.490936:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491045:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1da33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491065:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1da33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491080:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1da33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833917.491089:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787833917.491171:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491179:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491185:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491191:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.491205:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491232:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491244:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833917.491247:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.491251:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491258:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491272:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491278:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491284:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491289:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.491292:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491298:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491305:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f0e800) 00010000:00010000:1.0:1787833917.491308:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.491311:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491327:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491373:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec79 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491388:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1da33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec79 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.491395:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:1.0:1787833917.491397:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787833917.491400:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723a00, rc 0) 00000100:00100000:1.0:1787833917.491478:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504487840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+32:11327:x1874679381939200:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 818us (1031us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787833917.491486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 103 00000100:00100000:2.0:1787833917.493539:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.493650:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381939328 00000100:00100000:0.0:1787833917.493659:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381939328 00000100:00100000:0.0:1787833917.493716:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 104 00000100:00100000:0.0:1787833917.493725:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+32:11327:x1874679381939328:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:0.0:1787833917.493873:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.493889:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec5d expref: 32 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.493898:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.493931:0:13407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec5d expref: 32 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.493943:0:13407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec5d expref: 32 pid: 9772 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.493956:0:13407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504787c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406137728:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833917.494041:0:13407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ffd2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833917.495878:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.495929:0:13407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504787c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406137728:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833917.495949:0:13407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.495993:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381939584 00000100:00100000:1.0:1787833917.495998:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381939584 00000100:00100000:1.0:1787833917.496036:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:1.0:1787833917.496043:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+33:6173:x1874679381939584:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787833917.496337:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+34:6173:x1874679381939584:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 293us (464us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787833917.496345:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:2.0:1787833917.497895:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.497961:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381939712 00000100:00100000:1.0:1787833917.497967:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381939712 00010000:00010000:1.0:1787833917.497996:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec5d expref: 34 pid: 9772 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.498040:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:1.0:1787833917.498046:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+34:2400:x1874679381939712:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833917.498057:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833917.498064:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec5d expref: 34 pid: 9772 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.498076:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec5d expref: 34 pid: 9772 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.498098:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1d9d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec5d expref: 34 pid: 9772 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.498115:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:1.0:1787833917.498131:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.498140:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.498148:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.498177:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833917.498216:0:13407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.498225:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.498259:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.498266:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.498279:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.498285:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.498290:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.498298:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.498307:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:3.0:1787833917.498310:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833917.498315:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.498321:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1da41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.498464:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+33:11327:x1874679381939328:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 4739us (4931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.498464:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+33:2400:x1874679381939712:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 415us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.498472:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 104 00000100:00100000:1.0:1787833917.498472:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:3.0:1787833917.499827:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.499983:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381939968 00000100:00100000:1.0:1787833917.499999:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381939968 00000100:00100000:1.0:1787833917.500039:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:1.0:1787833917.500048:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+32:11327:x1874679381939968:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787833917.500346:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+33:11327:x1874679381939968:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 299us (524us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787833917.500354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:0.0:1787833917.546781:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.546885:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381940224 00000100:00100000:3.0:1787833917.546894:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381940224 00000100:00100000:3.0:1787833917.546942:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 105 00000100:00100000:3.0:1787833917.546953:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504786940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+33:11338:x1874679381940224:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:3.0:1787833917.546975:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833917.546995:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec80 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547077:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547092:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547102:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547115:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547122:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547128:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547250:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547259:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547267:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833917.547276:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787833917.547350:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547357:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547369:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547375:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.547379:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547387:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547400:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:3.0:1787833917.547402:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833917.547406:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547411:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547420:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547424:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547428:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547430:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.547432:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547442:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547447:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df502d22600) 00010000:00010000:3.0:1787833917.547448:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833917.547450:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547453:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547487:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec80 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547495:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec80 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.547500:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:3.0:1787833917.547501:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833917.547503:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7800, rc 0) 00000100:00100000:3.0:1787833917.547571:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504786940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+35:11338:x1874679381940224:12345-192.168.203.17@tcp:101:cat.0 Request processed in 621us (965us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787833917.547576:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 105 00000100:00100000:2.0:1787833917.551428:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.551636:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381940480 00000100:00100000:1.0:1787833917.551645:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381940480 00000100:00100000:1.0:1787833917.551698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:1.0:1787833917.551707:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+35:11338:x1874679381940480:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:1.0:1787833917.551983:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+36:11338:x1874679381940480:12345-192.168.203.17@tcp:35:cat.0 Request processed in 275us (564us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787833917.551991:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1787833917.574865:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.575024:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381940736 00000100:00100000:1.0:1787833917.575034:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381940736 00000100:00100000:1.0:1787833917.575158:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 106 00000100:00100000:1.0:1787833917.575169:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+36:11339:x1874679381940736:12345-192.168.203.17@tcp:36:rm.0 00010000:00010000:1.0:1787833917.575240:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787833917.575315:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd800/0x996d2fb20dc1d9fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec6b expref: 36 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575342:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec80 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575355:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1da33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec79 expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575389:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1d9ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec64 expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575399:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:1.0:1787833917.575403:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833917.575423:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575434:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575454:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575470:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575477:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575484:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575557:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575566:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575574:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787833917.575823:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:1.0:1787833917.575869:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575879:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575886:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575893:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575899:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575905:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575942:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833917.575961:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575967:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575972:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.575978:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.575982:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.575993:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833917.575996:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.576002:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.576007:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:1.0:1787833917.576012:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787833917.576017:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787833917.576019:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.576024:0:7455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.576027:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1da79 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.576042:0:7455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.576050:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.576057:0:7455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:2.0:1787833917.576060:0:7455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787833917.576064:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.576070:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.576076:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1da80 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.576079:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.576089:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.576092:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.576093:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833917.576097:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833917.576100:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.576102:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833917.576110:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833917.576113:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.576116:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.576130:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1da6b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833917.576139:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dfd4314 reply state 00000000c6e65c33 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.576148:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.576153:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f0e800) 00010000:00010000:1.0:1787833917.576156:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833917.576159:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833917.576240:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+34:11339:x1874679381940736:12345-192.168.203.17@tcp:36:rm.0 Request processed in 1072us (1383us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787833917.576248:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 106 00000100:00100000:0.0:1787833917.611546:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.611661:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381940992 00000100:00100000:3.0:1787833917.611670:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381940992 00000100:00100000:3.0:1787833917.611860:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 107 00000100:00100000:3.0:1787833917.611872:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504784780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+34:11345:x1874679381940992:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833917.611907:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833917.611927:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da87 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec87 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.612292:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.612308:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.612320:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.612331:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.612338:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.612345:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833917.612936:0:13407:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787833917.614012:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614038:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614051:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614106:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614113:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614119:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614125:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.614129:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614136:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614149:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:3.0:1787833917.614152:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833917.614156:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614162:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1da8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833917.614176:0:13407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006eeab489 reply state 00000000fd3b164e transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614186:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614191:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f0e800) 00010000:00010000:3.0:1787833917.614199:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787833917.614202:0:13407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787833917.614244:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1da87 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec87 expref: 37 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614259:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec87 expref: 36 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.614266:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df502d22600) 00010000:00010000:3.0:1787833917.614268:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833917.614271:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7800, rc 0) 00000100:00100000:3.0:1787833917.614340:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504784780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+37:11345:x1874679381940992:12345-192.168.203.17@tcp:101:bash.0 Request processed in 2470us (2803us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787833917.614349:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 107 00000100:00100000:2.0:1787833917.620646:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.620730:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381941120 00000100:00100000:1.0:1787833917.620738:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381941120 00000100:00100000:1.0:1787833917.620821:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:1.0:1787833917.620830:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2398:x1874679381941120:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833917.620847:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833917.620865:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec8e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787833917.620889:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787833917.620909:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787833917.620913:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833917.620922:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec8e expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.620966:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec8e expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.620979:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723400, rc 0) 00000100:00100000:1.0:1787833917.621050:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2398:x1874679381941120:12345-192.168.203.17@tcp:101:bash.0 Request processed in 221us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.621057:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:2.0:1787833917.627478:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.627584:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381941248 00000100:00100000:1.0:1787833917.627593:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381941248 00000100:00100000:1.0:1787833917.627646:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:1.0:1787833917.627655:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:11345:x1874679381941248:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833917.627671:0:8583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833917.627688:0:8583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec95 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.627727:0:8583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec8e expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.627736:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833917.627740:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833917.627745:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 9 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.627805:0:8583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec8e expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.627826:0:8583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec8e expref: 9 pid: 8430 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.627839:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8583:1874679406137856:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833917.627936:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112ee840 going to sleep for 11 seconds 00000100:00100000:2.0:1787833917.630312:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.630432:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8583:1874679406137856:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833917.630460:0:8583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 9 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.630477:0:8583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723200, rc 0) 00000100:00100000:1.0:1787833917.630531:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+9:11345:x1874679381941248:12345-192.168.203.17@tcp:101:bash.0 Request processed in 2877us (3062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.630540:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:3.0:1787833917.631048:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381941376 00000100:00100000:3.0:1787833917.631055:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381941376 00010000:00010000:3.0:1787833917.631085:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec8e expref: 9 pid: 8430 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.631162:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:3.0:1787833917.631171:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381941376:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833917.631184:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833917.631204:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec8e expref: 9 pid: 8430 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.631224:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec8e expref: 9 pid: 8430 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.631265:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1daaa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec8e expref: 9 pid: 8430 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.631279:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833917.631283:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833917.631290:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.631301:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.631331:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.631344:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504615a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6499:1874679406137984:192.168.203.17@tcp:105: 00000100:00100000:3.0:1787833917.631407:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e73180 going to sleep for 11 seconds 00000100:00100000:3.0:1787833917.637608:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504615a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6499:1874679406137984:192.168.203.17@tcp:105: 00010000:00010000:3.0:1787833917.637636:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833917.637693:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381941376:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 6522us (7387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.637711:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:2.0:1787833917.641694:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.642163:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381941632 00000100:00100000:3.0:1787833917.642173:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381941632 00000100:00100000:2.0:1787833917.642350:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:2.0:1787833917.642362:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+37:11345:x1874679381941632:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:2.0:1787833917.642675:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+38:11345:x1874679381941632:12345-192.168.203.17@tcp:35:bash.0 Request processed in 314us (989us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787833917.642683:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:3.0:1787833917.784666:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.784771:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381941760 00000100:00100000:1.0:1787833917.784781:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381941760 00000100:00100000:1.0:1787833917.784841:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 108 00000100:00100000:1.0:1787833917.784998:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504615a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+38:11361:x1874679381941760:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833917.785025:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833917.785044:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dab8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ec9c expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.785176:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dabf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.785273:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dabf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.785284:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dabf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833917.785325:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787833917.785329:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833917.785347:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dabf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.785370:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec9c expref: 40 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.785389:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dabf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec9c expref: 39 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.785398:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833917.785401:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833917.785404:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722800, rc 0) 00000100:00100000:1.0:1787833917.785591:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504615a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+39:11361:x1874679381941760:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 740us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.785607:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 108 00000100:00100000:0.0:1787833917.786000:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406138112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833917.786049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833917.786370:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406138112 00000100:00100000:2.0:1787833917.786377:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406138112 00000100:00100000:2.0:1787833917.786418:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787833917.786426:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406138112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833917.786451:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833917.786499:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406138112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833917.786505:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787833917.786616:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406138112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833917.793004:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.793313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381942016 00000100:00100000:1.0:1787833917.793323:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381942016 00000100:00100000:1.0:1787833917.793380:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 109 00000100:00100000:1.0:1787833917.793390:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+39:11361:x1874679381942016:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833917.793410:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833917.793445:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dac6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eca3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.793549:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dacd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.793563:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dacd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.793574:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dacd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833917.793585:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787833917.793820:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dac6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eca3 expref: 42 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.793839:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dacd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eca3 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.793848:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df502d22600) 00010000:00010000:1.0:1787833917.793851:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833917.793920:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722600, rc 0) 00000100:00100000:1.0:1787833917.793981:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+41:11361:x1874679381942016:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 592us (986us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1787833917.793988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 109 00000100:00100000:3.0:1787833917.796391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.796443:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.796457:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381942272 00000100:00100000:0.0:1787833917.796466:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381942272 00000100:00100000:0.0:1787833917.796527:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 110 00000100:00100000:0.0:1787833917.796537:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+41:11361:x1874679381942272:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833917.796557:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833917.796576:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dadb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecaa expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.796677:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1dae2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.796690:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1dae2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.796701:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1dae2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833917.796712:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787833917.796842:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dadb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecaa expref: 44 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.797023:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1dae2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecaa expref: 43 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.797169:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df502d22600) 00010000:00010000:0.0:1787833917.797174:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787833917.797178:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247200, rc 0) 00000100:00100000:0.0:1787833917.797404:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+43:11361:x1874679381942272:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 868us (1021us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787833917.797411:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 110 00000100:00100000:2.0:1787833917.797483:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381942400 00000100:00100000:2.0:1787833917.797488:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381942400 00000100:00100000:2.0:1787833917.797533:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:2.0:1787833917.797542:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504616580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+43:2400:x1874679381942400:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833917.797552:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833917.797568:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dacd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eca3 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.797579:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df502d22600) 00010000:00010000:2.0:1787833917.797583:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833917.797615:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504616580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+42:2400:x1874679381942400:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 74us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833917.797629:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:3.0:1787833917.807848:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.808113:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381942528 00000100:00100000:1.0:1787833917.808122:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381942528 00000100:00100000:1.0:1787833917.808232:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:1.0:1787833917.808243:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504615680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2401:x1874679381942528:12345-192.168.203.17@tcp:1:lfs.0 00010000:00010000:1.0:1787833917.808303:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.808323:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.808332:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833917.808336:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833917.808340:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.808372:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.808386:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 8 pid: 8583 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.808401:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874679406138240:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833917.808486:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833917.810720:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874679406138240:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833917.810747:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.813541:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.813648:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381942656 00000100:00100000:1.0:1787833917.813658:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381942656 00002000:00100000:1.0:1787833917.813705:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8df504617c00 x1874679381942656/t0(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:723/0 lens 504/0 e 0 to 0 dl 1787833928 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787833917.813716:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504617c00 with x1874679381942656 ext(0->8) 00010000:00010000:1.0:1787833917.813726:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 9 pid: 8583 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.816431:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 9 pid: 8583 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787833917.816446:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df504617c00 00000100:00100000:1.0:1787833917.816531:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:1.0:1787833917.816551:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504617c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2401:x1874679381942656:12345-192.168.203.17@tcp:4:lfs.0 00000100:00100000:1.0:1787833917.818396:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504617c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2401:x1874679381942656:12345-192.168.203.17@tcp:4:lfs.0 Request processed in 1847us (4855us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787833917.818410:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00002000:00100000:1.0:1787833917.818422:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8df504617c00 x1874679381942656/t4294967303(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:723/0 lens 504/448 e 0 to 0 dl 1787833928 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787833917.818433:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504617c00 with x1874679381942656 ext(0->8) 00010000:00010000:1.0:1787833917.818444:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 11 pid: 8583 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.818461:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 11 pid: 8583 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787833917.818469:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df504617c00 00000100:00100000:1.0:1787833917.825265:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.826707:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381942784 00000100:00100000:0.0:1787833917.826720:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381942784 00010000:00010000:0.0:1787833917.826780:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 11 pid: 8583 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.826955:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:0.0:1787833917.826966:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e165450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2398:x1874679381942784:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833917.826983:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787833917.827000:0:8457:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787833917.827003:0:8457:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787833917 00002000:00010000:0.0:1787833917.827005:0:8457:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787833918 00002000:00010000:0.0:1787833917.827007:0:8457:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787833917 00002000:00010000:0.0:1787833917.827009:0:8457:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787833917.827016:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 11 pid: 8583 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.827030:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 11 pid: 8583 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.827085:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1dab1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec95 expref: 11 pid: 8583 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.827100:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833917.827104:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833917.827110:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.827119:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.827151:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833917.827186:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.827199:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.827230:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.827239:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.827247:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.827255:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833917.827260:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.827270:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e165450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+10:2398:x1874679381942784:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 303us (2011us total) trans 0 rc 0/0 00010000:00010000:2.0:1787833917.827271:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833917.827281:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00010000:00010000:2.0:1787833917.827299:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.827308:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1daf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833917.827363:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504615680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2401:x1874679381942528:12345-192.168.203.17@tcp:1:lfs.0 Request processed in 19122us (19524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833917.827371:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:3.0:1787833917.831475:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.834164:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381943040 00000100:00100000:1.0:1787833917.834179:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381943040 00000100:00100000:1.0:1787833917.834258:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:1.0:1787833917.834269:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df610443850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+42:11361:x1874679381943040:12345-192.168.203.17@tcp:35:lfs.0 00000004:00010000:1.0:1787833917.834345:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1dae2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecaa expref: 42 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833917.834531:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1787833917.834563:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787833917.836020:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1787833917.836877:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.836901:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec87 expref: 46 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.836910:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.836951:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec87 expref: 46 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.836968:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec87 expref: 46 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.836981:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874679406138368:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833917.837195:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112ee840 going to sleep for 11 seconds 00000100:00100000:2.0:1787833917.840312:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874679406138368:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833917.840354:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.841006:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833917.841432:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381943168 00000100:00100000:2.0:1787833917.841442:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381943168 00010000:00010000:2.0:1787833917.841478:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec87 expref: 47 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833917.841548:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:2.0:1787833917.841558:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504616d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+47:2400:x1874679381943168:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833917.841571:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833917.841577:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec87 expref: 47 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.841589:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec87 expref: 47 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.841626:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1da9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec87 expref: 47 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.841640:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df502d22600) 00010000:00010000:2.0:1787833917.841645:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.841654:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.841661:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833917.841693:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833917.841748:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504616d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+46:2400:x1874679381943168:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 190us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833917.841788:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00010000:00010000:1.0:1787833917.841968:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.841976:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833917.842096:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1787833917.842206:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787833917.842298:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406138496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787833917.842340:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833917.842369:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6053dc600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833917.842588:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406138496 00000100:00100000:0.0:1787833917.842593:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406138496 00000100:00100000:0.0:1787833917.842629:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787833917.842636:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620512d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1874679406138496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833917.842716:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620512d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1874679406138496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833917.842722:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787833917.843067:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406138496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787833917.843182:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1787833917.843237:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406138624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787833917.843458:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833917.843484:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833917.843543:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406138624 00000100:00100000:0.0:1787833917.843547:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406138624 00000100:00100000:0.0:1787833917.843587:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787833917.843594:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620510780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1874679406138624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833917.843693:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620510780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6516:x1874679406138624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (235us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787833917.843699:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787833917.844070:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406138624:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787833917.844121:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1787833917.844153:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.844162:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.844170:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.844176:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.844181:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.844189:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.844203:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df502d22600) 00010000:00010000:1.0:1787833917.844206:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787833917.844225:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.844231:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1daf7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787833917.844555:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787833917.844615:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787833917.844625:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393757874117ns, next at 394757872091ns, rc = 0 00000001:00080000:1.0:1787833917.844631:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1787833917.844652:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df502d22600) 00010000:00010000:1.0:1787833917.844656:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787833917.844662:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1dae2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecaa expref: 50 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.844778:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df610443850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+49:11361:x1874679381943040:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 10484us (13286us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787833917.844787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000020:00080000:1.0:1787833917.844791:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787833917.847283:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.847443:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381943296 00000100:00100000:1.0:1787833917.847462:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381943296 00000100:00100000:1.0:1787833917.847521:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 111 00000100:00100000:1.0:1787833917.847531:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504616940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+49:11361:x1874679381943296:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833917.847553:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833917.847573:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1dafe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecb1 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.847627:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1dafe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb1 expref: 50 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.847660:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1dafe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb1 expref: 50 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.847678:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:1.0:1787833917.847682:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833917.847685:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722000, rc 0) 00000100:00100000:1.0:1787833917.847747:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504616940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+50:11361:x1874679381943296:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 218us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.847775:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 111 00000100:00100000:0.0:1787833917.854493:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833917.854588:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381943552 00000100:00100000:2.0:1787833917.854669:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381943552 00000100:00100000:2.0:1787833917.854728:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1787833917.854738:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+50:11361:x1874679381943552:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1787833917.855586:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+51:11361:x1874679381943552:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 844us (1096us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787833917.855605:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1787833917.899034:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.899135:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381943680 00000100:00100000:1.0:1787833917.899144:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381943680 00000100:00100000:1.0:1787833917.899202:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 112 00000100:00100000:1.0:1787833917.899221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+51:11371:x1874679381943680:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:1.0:1787833917.899347:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899364:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899376:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899389:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899396:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899419:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899485:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899494:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899500:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833917.899543:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899555:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899561:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899567:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899573:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.899578:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899585:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899597:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833917.899605:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.899610:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899615:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899630:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899636:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899642:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899646:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.899649:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899654:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899662:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f0e800) 00010000:00010000:1.0:1787833917.899664:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.899667:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899672:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899681:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899695:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899700:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899705:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833917.899708:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899714:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899721:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:1.0:1787833917.899724:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833917.899727:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833917.899733:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833917.899834:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+51:11371:x1874679381943680:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 615us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833917.899840:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 112 00000100:00100000:3.0:1787833917.946015:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833917.946341:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381943936 00000100:00100000:0.0:1787833917.946441:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381943936 00000100:00100000:0.0:1787833917.946509:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 113 00000100:00100000:0.0:1787833917.946519:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504614780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+51:11374:x1874679381943936:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833917.946539:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833917.946559:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1db1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecb8 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946642:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946656:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946668:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946690:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946698:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946704:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946868:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946877:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946884:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833917.946894:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787833917.946966:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946972:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946979:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946984:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833917.946988:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.946996:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947007:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833917.947010:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833917.947014:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947029:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947042:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947048:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947053:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947058:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833917.947061:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947066:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947074:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f0e800) 00010000:00010000:0.0:1787833917.947076:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833917.947078:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947084:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1db28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947118:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1db1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb8 expref: 54 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947144:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb8 expref: 53 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833917.947151:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833917.947153:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833917.947156:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247e00, rc 0) 00000100:00100000:0.0:1787833917.947251:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504614780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+53:11374:x1874679381943936:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 733us (1245us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787833917.947258:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 113 00000100:00100000:0.0:1787833917.951864:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833917.952004:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381944064 00000100:00100000:3.0:1787833917.952013:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381944064 00000100:00100000:3.0:1787833917.952080:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:3.0:1787833917.952091:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+53:11374:x1874679381944064:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:3.0:1787833917.952152:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.952167:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.952177:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.952220:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.952228:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.952235:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.952241:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833917.952261:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.952269:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.952287:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:3.0:1787833917.952290:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833917.952295:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.952301:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833917.952376:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+53:11374:x1874679381944064:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 287us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833917.952384:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:2.0:1787833917.954934:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833917.955460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381944320 00000100:00100000:1.0:1787833917.955471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381944320 00000100:00100000:1.0:1787833917.955525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:1.0:1787833917.955535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+53:11374:x1874679381944320:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787833917.955741:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+54:11374:x1874679381944320:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 205us (811us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787833917.955813:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:2.0:1787833918.038910:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833918.039026:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381944576 00000100:00100000:1.0:1787833918.039036:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381944576 00000100:00080000:0.0:1787833918.039179:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833918.039337:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:1.0:1787833918.039349:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+54:11384:x1874679381944576:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833918.039373:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833918.039376:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787833918.039401:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dabf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec9c expref: 54 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.039418:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:1.0:1787833918.039423:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833918.039434:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db44 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecbf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.039547:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.039560:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb8 expref: 54 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.039568:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.039598:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb8 expref: 54 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.039609:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb8 expref: 54 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833918.039629:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406138752:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833918.039724:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833918.047986:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406138752:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833918.048016:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833918.049121:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833918.049243:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381944704 00000100:00100000:3.0:1787833918.049250:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381944704 00010000:00010000:3.0:1787833918.049288:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb8 expref: 55 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833918.049329:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:3.0:1787833918.049338:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+55:2401:x1874679381944704:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833918.049353:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833918.049359:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb8 expref: 55 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.049370:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb8 expref: 55 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.049405:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb8 expref: 55 pid: 13407 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.049418:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:3.0:1787833918.049423:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.049431:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.049438:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.049464:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833918.049514:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+54:2401:x1874679381944704:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 176us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833918.049522:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00010000:00010000:1.0:1787833918.049712:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.049720:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833918.049739:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787833918.049917:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecbf expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.049932:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecbf expref: 54 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.049939:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:1.0:1787833918.049941:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833918.049943:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722c00, rc 0) 00000100:00100000:1.0:1787833918.049971:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+54:11384:x1874679381944576:12345-192.168.203.17@tcp:101:bash.0 Request processed in 10625us (11071us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787833918.049978:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:2.0:1787833918.053692:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833918.053821:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381944832 00000100:00100000:1.0:1787833918.053853:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381944832 00000100:00100000:1.0:1787833918.053909:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:1.0:1787833918.053920:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+54:11384:x1874679381944832:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833918.053943:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833918.053964:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1db59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecc6 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.053999:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.054013:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.054025:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.054346:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1db59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecc6 expref: 56 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.054366:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecc6 expref: 55 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.054374:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:1.0:1787833918.054377:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787833918.054380:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723400, rc 0) 00000100:00100000:1.0:1787833918.054444:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+55:11384:x1874679381944832:12345-192.168.203.17@tcp:101:bash.0 Request processed in 526us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833918.054451:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:0.0:1787833918.057911:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833918.058486:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381945088 00000100:00100000:3.0:1787833918.058496:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381945088 00000100:00100000:3.0:1787833918.058557:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:3.0:1787833918.058568:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+55:11384:x1874679381945088:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:3.0:1787833918.058807:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.058823:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.059627:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833918.059706:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1787833918.059732:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fbab8ee reply state 00000000748cd95b transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.059747:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.059790:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:3.0:1787833918.059793:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787833918.059797:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833918.060017:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+58:11384:x1874679381945088:12345-192.168.203.17@tcp:36:bash.0 Request processed in 1448us (2113us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787833918.060026:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 117 00000020:00080000:3.0:1787833918.060031:0:6513:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787833918.064015:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833918.064485:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381945216 00000100:00100000:1.0:1787833918.064512:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381945216 00000100:00100000:1.0:1787833918.064580:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:1.0:1787833918.064591:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+58:11384:x1874679381945216:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833918.064615:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833918.064637:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1db6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eccd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.064726:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.064740:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecbf expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.064768:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.064804:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecbf expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833918.064817:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecbf expref: 59 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833918.064830:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406138880:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833918.068854:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833918.071602:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833918.071788:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406138880:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833918.071815:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833918.073827:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381945344 00000100:00100000:3.0:1787833918.073895:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381945344 00010000:00010000:2.0:1787833918.074040:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecbf expref: 60 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833918.074423:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:2.0:1787833918.074435:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+60:2400:x1874679381945344:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833918.074453:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833918.074461:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecbf expref: 60 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.074476:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecbf expref: 60 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.074500:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1db4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecbf expref: 60 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.074517:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:2.0:1787833918.074522:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.074532:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.074541:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.074593:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833918.074655:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+59:2400:x1874679381945344:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 224us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833918.074662:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 71 00010000:00010000:0.0:1787833918.074723:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.074732:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833918.074813:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787833918.074818:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833918.074847:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.074888:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1db6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eccd expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.074903:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eccd expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.074910:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833918.074913:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833918.074916:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722e00, rc 0) 00000100:00100000:0.0:1787833918.074943:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+58:11384:x1874679381945216:12345-192.168.203.17@tcp:101:bash.0 Request processed in 10355us (10936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833918.074951:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:1.0:1787833918.077507:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833918.077583:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381945600 00000100:00100000:2.0:1787833918.077593:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381945600 00000100:00100000:2.0:1787833918.077685:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:2.0:1787833918.077696:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+58:11384:x1874679381945600:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:2.0:1787833918.077951:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11384:x1874679381945600:12345-192.168.203.17@tcp:35:bash.0 Request processed in 257us (452us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1787833918.077960:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:3.0:1787833918.148899:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833918.149002:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381945728 00000100:00100000:0.0:1787833918.149010:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381945728 00000100:00100000:0.0:1787833918.149071:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:0.0:1787833918.149082:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+59:11390:x1874679381945728:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833918.149103:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833918.149128:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.149192:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1db83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.149214:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1db83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.149226:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1db83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833918.149277:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787833918.149281:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833918.149297:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1db83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.149318:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecd4 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.149333:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1db83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecd4 expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.149341:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833918.149344:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833918.149347:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247200, rc 0) 00000100:00100000:0.0:1787833918.149401:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11390:x1874679381945728:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 322us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833918.149407:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:3.0:1787833918.155835:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833918.156226:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381945856 00000100:00100000:0.0:1787833918.156236:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381945856 00000100:00100000:0.0:1787833918.156330:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:0.0:1787833918.156340:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11390:x1874679381945856:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833918.156359:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833918.156376:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecdb expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156447:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156473:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156491:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156504:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156510:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156517:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156584:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156594:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156601:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833918.156640:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787833918.156644:0:13407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833918.156662:0:13407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156674:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156692:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156698:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156704:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156710:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833918.156715:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156722:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156734:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833918.156737:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833918.156742:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156783:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1db91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156797:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156804:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156810:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156823:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833918.156826:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156832:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156840:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f0e800) 00010000:00010000:0.0:1787833918.156843:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833918.156846:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156852:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1db98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156876:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1db8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecdb expref: 62 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156889:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecdb expref: 61 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.156896:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833918.156898:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833918.156901:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247e00, rc 0) 00000100:00100000:0.0:1787833918.157021:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11390:x1874679381945856:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 682us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833918.157028:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:1.0:1787833918.160326:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833918.160401:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381945984 00000100:00100000:3.0:1787833918.160412:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381945984 00000100:00100000:1.0:1787833918.160423:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833918.160486:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:3.0:1787833918.160496:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+61:2400:x1874679381945984:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833918.160511:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833918.160534:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1db9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecdb expref: 61 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.160552:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:3.0:1787833918.160557:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833918.160627:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+60:2400:x1874679381945984:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 133us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833918.160635:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1787833918.160797:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381946240 00000100:00100000:0.0:1787833918.160811:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381946240 00000100:00100000:0.0:1787833918.160849:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:0.0:1787833918.160857:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11390:x1874679381946240:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833918.160871:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833918.160885:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dba6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ece2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.161002:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.161015:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eccd expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.161025:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.161062:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eccd expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.161075:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eccd expref: 61 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833918.161088:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504784b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406139008:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833918.161172:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833918.165114:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833918.165247:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381946368 00000100:00100000:2.0:1787833918.165256:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381946368 00010000:00010000:2.0:1787833918.165295:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eccd expref: 62 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833918.165337:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:2.0:1787833918.165348:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+62:2401:x1874679381946368:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833918.165362:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833918.165368:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eccd expref: 62 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.165381:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eccd expref: 62 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.165402:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:2.0:1787833918.165421:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.165431:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.165438:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833918.165456:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833918.165513:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+62:2401:x1874679381946368:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 166us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833918.165521:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 72 00010000:00010000:0.0:1787833918.167507:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1db75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eccd expref: 61 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833918.167532:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504784b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406139008:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833918.167572:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.167582:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.167587:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833918.167609:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787833918.167735:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dba6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece2 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.169162:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece2 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.169176:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833918.169179:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787833918.169183:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247400, rc 0) 00000100:00100000:0.0:1787833918.169311:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11390:x1874679381946240:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 8454us (8886us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787833918.169321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:1.0:1787833918.175666:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833918.175912:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381946624 00000100:00100000:3.0:1787833918.175976:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381946624 00000100:00100000:3.0:1787833918.176138:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1787833918.176150:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11390:x1874679381946624:12345-192.168.203.17@tcp:103:lfs.0 00010000:00010000:3.0:1787833918.176166:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833918.176202:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1dafe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecb1 expref: 61 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.176230:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:3.0:1787833918.176234:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833918.176291:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11390:x1874679381946624:12345-192.168.203.17@tcp:103:lfs.0 Request processed in 144us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833918.176300:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:2.0:1787833918.181487:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833918.181583:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381946752 00000100:00100000:3.0:1787833918.181592:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381946752 00000100:00100000:3.0:1787833918.181685:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00100000:3.0:1787833918.181695:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11390:x1874679381946752:12345-192.168.203.17@tcp:58:lfs.0 00010000:00010000:3.0:1787833918.181855:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.181873:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833918.181886:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833918.182291:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787833918.182380:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11390:x1874679381946752:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 686us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833918.182388:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00100000:2.0:1787833918.186662:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833918.186889:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381946880 00000100:00100000:0.0:1787833918.186898:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381946880 00000100:00100000:0.0:1787833918.186966:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:0.0:1787833918.186975:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+60:11390:x1874679381946880:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833918.186994:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833918.187013:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ece9 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.187269:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.187280:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece9 expref: 61 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.187299:0:13407:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.187312:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece9 expref: 61 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.187336:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833918.187339:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833918.187342:0:13407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece9 expref: 61 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833918.187350:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247600, rc 0) 00000100:00100000:0.0:1787833918.187410:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11390:x1874679381946880:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 435us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833918.187418:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 123 00010000:00010000:1.0:1787833918.230581:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833918.294261:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833918.294286:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406139136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833918.294371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833918.294514:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406139136 00000100:00100000:2.0:1787833918.294521:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406139136 00000100:00100000:2.0:1787833918.294578:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787833918.294588:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504614f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3641:x1874679406139136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833918.295523:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787833918.295594:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504614f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3641:x1874679406139136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1007us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833918.295602:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787833918.295744:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833918.295770:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df61189d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406139264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833918.295802:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833918.295840:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406139264 00000100:00100000:1.0:1787833918.295844:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406139264 00000100:00100000:1.0:1787833918.295882:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787833918.295890:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406139264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833918.295902:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787833918.295933:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406139264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833918.295939:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1787833918.295956:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787833918.295988:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df61189d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406139264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833918.296218:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406139648:0@lo:400:kworker.0 00000100:00100000:2.0:1787833918.296245:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833918.296263:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406140160:0@lo:400:kworker.0 00000100:00100000:2.0:1787833918.296285:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833918.296297:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406140672:0@lo:400:kworker.0 00000100:00100000:2.0:1787833918.296337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833918.296356:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787833918.296362:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406139776:0@lo:400:kworker.0 00000100:00100000:2.0:1787833918.296381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833918.296395:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406140288:0@lo:400:kworker.0 00000100:00100000:2.0:1787833918.296415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833918.296439:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406139648 00000100:00100000:2.0:1787833918.296442:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406139648 00000100:00100000:2.0:1787833918.296467:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787833918.296472:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406139648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833918.296506:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406139648:12345-0@lo:400:kworker.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833918.296512:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787833918.296532:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406140288 00000100:00100000:2.0:1787833918.296535:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406140288 00000100:00100000:2.0:1787833918.296562:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787833918.296568:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406140288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833918.296598:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406140288:12345-0@lo:400:kworker.0 Request processed in 29us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833918.296603:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1787833918.296617:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833918.296634:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406140288:0@lo:400:kworker.0 00000100:00100000:2.0:1787833918.296644:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406139648:0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.296714:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406139520:0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.296744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833918.296789:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406140032:0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.296813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833918.296827:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406140544:0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.296852:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833918.296865:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787833918.296871:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406139392:0@lo:400:kworker.0 00000100:00100000:0.0:1787833918.296891:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406139136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833918.296894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833918.296911:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406140160 00000100:00100000:3.0:1787833918.296914:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406139904:0@lo:400:kworker.0 00000100:00100000:0.0:1787833918.296915:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406140160 00000100:00100000:3.0:1787833918.296935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833918.296938:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406140672 00000100:00100000:0.0:1787833918.296941:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406140672 00000100:00100000:3.0:1787833918.296948:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406140416:0@lo:400:kworker.0 00000100:00100000:0.0:1787833918.296954:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406139776 00000100:00100000:0.0:1787833918.296963:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406139776 00000100:00100000:3.0:1787833918.296967:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833918.296978:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406139520 00000100:00100000:0.0:1787833918.296981:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406139520 00000100:00100000:3.0:1787833918.296991:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406139392 00000100:00100000:0.0:1787833918.296991:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406140032 00000100:00100000:0.0:1787833918.296993:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406140032 00000100:00100000:3.0:1787833918.296994:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406139392 00000100:00100000:0.0:1787833918.297005:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406140544 00000100:00100000:0.0:1787833918.297007:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406140544 00000100:00100000:3.0:1787833918.297017:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787833918.297020:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787833918.297023:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406139392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833918.297026:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406140160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.297061:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406139392:12345-0@lo:400:kworker.0 Request processed in 37us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833918.297061:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406140160:12345-0@lo:400:kworker.0 Request processed in 34us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833918.297067:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787833918.297067:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787833918.297080:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787833918.297085:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406140672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.297094:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406140416 00000100:00100000:3.0:1787833918.297098:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406140416 00000100:00100000:0.0:1787833918.297110:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406140672:12345-0@lo:400:kworker.0 Request processed in 25us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833918.297116:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787833918.297117:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787833918.297122:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406140416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833918.297126:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787833918.297131:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406139776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.297148:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406140416:12345-0@lo:400:kworker.0 Request processed in 26us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833918.297151:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406139776:12345-0@lo:400:kworker.0 Request processed in 21us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833918.297154:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787833918.297156:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787833918.297165:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787833918.297170:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504616580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406139520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.297174:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406139392:0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.297183:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406140416:0@lo:400:kworker.0 00000100:00100000:0.0:1787833918.297194:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504616580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406139520:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833918.297198:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787833918.297201:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406139520:0@lo:400:kworker.0 00000100:00100000:0.0:1787833918.297231:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787833918.297236:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406140032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833918.297270:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406140032:12345-0@lo:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833918.297278:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406139904 00000100:00100000:1.0:1787833918.297296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406139904 00000100:00080000:2.0:1787833918.297320:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787833918.297323:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787833918.297339:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406139776:0@lo:400:kworker.0 00010000:00080000:2.0:1787833918.297361:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6059eb0c0 x1874679406140160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833918.297371:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406140160:0@lo:400:kworker.0 00010000:00080000:2.0:1787833918.297380:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6059e9e00 x1874679406140672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833918.297388:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406140672:0@lo:400:kworker.0 00000100:00100000:1.0:1787833918.297452:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787833918.297460:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406139904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833918.297489:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406139904:12345-0@lo:400:kworker.0 Request processed in 30us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833918.297494:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787833918.297787:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787833918.297797:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406140544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.297830:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406140544:12345-0@lo:400:kworker.0 Request processed in 36us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833918.297836:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787833918.297865:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406139904:0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.297875:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406140032:0@lo:400:kworker.0 00000100:00100000:3.0:1787833918.297883:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406140544:0@lo:400:kworker.0 00000100:00100000:0.0:1787833918.297987:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000040:00080000:1.0:1787833919.189999:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833919.190010:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833919.190215:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787833919.190225:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833919.190400:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df61189d2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406140800:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787833919.190526:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833919.198124:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df61189d2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406140800:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787833919.199926:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.200209:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381947008 00000100:00100000:3.0:1787833919.200219:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381947008 00000100:00100000:3.0:1787833919.200299:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:3.0:1787833919.200309:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11391:x1874679381947008:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787833919.200342:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787833919.200625:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11391:x1874679381947008:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 188us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833919.200634:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:2.0:1787833919.209359:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833919.209469:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381947136 00000100:00100000:0.0:1787833919.209480:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381947136 00000100:00100000:0.0:1787833919.209559:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:0.0:1787833919.209572:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11391:x1874679381947136:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787833919.209653:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.209672:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.209687:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.209703:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.209710:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.209715:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.209737:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.209744:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.209821:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833919.210126:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787833919.210132:0:13407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833919.210145:0:13407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210157:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210163:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210170:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210176:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.210180:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210187:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210207:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:0.0:1787833919.210210:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.210215:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210222:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dbc9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210248:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210254:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210259:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210264:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.210267:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210273:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210281:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8df503f02500) 00010000:00010000:0.0:1787833919.210283:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.210286:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210291:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dbd0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210306:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210311:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210317:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210329:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.210332:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210340:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210349:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833919.210351:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.210354:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.210359:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dbd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833919.210444:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11391:x1874679381947136:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 873us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833919.210452:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:1.0:1787833919.225126:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833919.225269:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381947392 00000100:00100000:2.0:1787833919.225279:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381947392 00000100:00100000:2.0:1787833919.225345:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:2.0:1787833919.225356:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+61:11391:x1874679381947392:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833919.225380:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833919.225401:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dbde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecf0 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.225528:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.225544:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.225556:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833919.225568:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787833919.225672:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.225696:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.225703:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.225709:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fe00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833919.225713:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.225720:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.225734:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:2.0:1787833919.225737:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787833919.225742:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.226005:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dbe5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.226730:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dbde lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecf0 expref: 63 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.226746:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:2.0:1787833919.226771:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833919.226776:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dbde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecf0 expref: 63 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.226799:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f600, rc 0) 00000100:00100000:2.0:1787833919.226924:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+62:11391:x1874679381947392:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1569us (1806us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787833919.226933:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:3.0:1787833919.242985:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833919.243139:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381947520 00000100:00100000:0.0:1787833919.243149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381947520 00000100:00100000:0.0:1787833919.243224:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 127 00000100:00100000:0.0:1787833919.243234:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+62:11391:x1874679381947520:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787833919.243271:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787833919.243387:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+62:11391:x1874679381947520:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 155us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833919.243395:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 127 00000100:00100000:2.0:1787833919.248536:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.248744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381947776 00000100:00100000:3.0:1787833919.248799:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381947776 00000100:00100000:3.0:1787833919.248860:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:3.0:1787833919.248871:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+62:11391:x1874679381947776:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833919.248891:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833919.248894:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787833919.248922:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1db83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecd4 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.248941:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:3.0:1787833919.248945:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833919.248958:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1dbf3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecf7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833919.249320:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787833919.249459:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1dbfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.249471:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1dbfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.249501:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1dbfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.249868:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1dbf3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecf7 expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.249887:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1dbfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecf7 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.249895:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df502d22c00) 00010000:00010000:3.0:1787833919.249898:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833919.249902:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030600, rc 0) 00000100:00100000:3.0:1787833919.249971:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+63:11391:x1874679381947776:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1102us (1453us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787833919.249980:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 128 00010000:00010000:2.0:1787833919.255501:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833919.256318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833919.256447:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381948032 00000100:00100000:0.0:1787833919.256460:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381948032 00000100:00100000:0.0:1787833919.256590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:0.0:1787833919.256602:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+63:11391:x1874679381948032:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833919.256663:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833919.256691:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1dbfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecf7 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256710:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df502d22c00) 00010000:00010000:0.0:1787833919.256721:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833919.256743:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256791:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256811:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256875:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256884:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256891:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256934:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256942:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256959:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256966:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.256971:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256979:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.256987:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833919.256990:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.256994:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.257000:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc08 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.257010:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.257028:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.257034:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.257040:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.257043:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.257059:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.257068:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x4efb84d2 (ffff8df503f02500) 00010000:00010000:0.0:1787833919.257070:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.257073:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.257079:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc0f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4efb84d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833919.257169:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+62:11391:x1874679381948032:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 569us (858us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833919.257176:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:0.0:1787833919.261031:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833919.261229:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381948160 00000100:00100000:2.0:1787833919.261239:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381948160 00000100:00100000:2.0:1787833919.261299:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:2.0:1787833919.261309:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504784b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+62:11391:x1874679381948160:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833919.261341:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833919.261363:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dc16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ecfe expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.261402:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.261415:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.261425:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.261548:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dc16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecfe expref: 64 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.261566:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecfe expref: 63 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.261574:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:2.0:1787833919.261582:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787833919.261586:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e000, rc 0) 00000100:00100000:2.0:1787833919.261663:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504784b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+63:11391:x1874679381948160:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 355us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833919.261671:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:2.0:1787833919.269557:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.269744:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381948416 00000100:00100000:1.0:1787833919.269777:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381948416 00000100:00100000:1.0:1787833919.269839:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 131 00000100:00100000:1.0:1787833919.269849:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+63:11391:x1874679381948416:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787833919.269934:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.269952:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.269963:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787833919.270130:0:9772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1787833919.270141:0:9772:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395183389890ns, next at 396183386972ns, rc = 0 00000004:00010000:1.0:1787833919.270191:0:9772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d146e06f reply state 0000000051934bd1 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.270215:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.270223:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:1.0:1787833919.270226:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787833919.270229:0:9772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833919.270335:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+65:11391:x1874679381948416:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 487us (788us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787833919.270344:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 131 00000100:00100000:1.0:1787833919.275155:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833919.275737:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381948544 00000100:00100000:0.0:1787833919.275747:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381948544 00000100:00100000:0.0:1787833919.275850:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 132 00000100:00100000:0.0:1787833919.275865:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+65:11391:x1874679381948544:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833919.275890:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833919.275912:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed05 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.275973:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed05 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.275988:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed05 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.276023:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:0.0:1787833919.276026:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833919.276029:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246200, rc 0) 00000100:00100000:0.0:1787833919.276098:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+66:11391:x1874679381948544:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 235us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833919.276106:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 132 00000100:00100000:0.0:1787833919.279920:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833919.280646:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381948672 00000100:00100000:2.0:1787833919.280657:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381948672 00000100:00100000:2.0:1787833919.280964:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:2.0:1787833919.280977:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381948672:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787833919.281531:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381948672:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 555us (1618us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787833919.281540:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00080000:0.0:1787833919.286079:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833919.286522:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.286654:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381948928 00000100:00100000:1.0:1787833919.286664:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381948928 00000100:00100000:1.0:1787833919.286732:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:1.0:1787833919.286743:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+66:11391:x1874679381948928:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787833919.287001:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+67:11391:x1874679381948928:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 259us (483us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1787833919.287008:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:1.0:1787833919.293738:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.293876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381949184 00000100:00100000:3.0:1787833919.293887:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381949184 00000100:00100000:3.0:1787833919.293963:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:3.0:1787833919.293973:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+67:11391:x1874679381949184:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787833919.294089:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+67:11391:x1874679381949184:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 118us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833919.294097:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:0.0:1787833919.302033:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.302349:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381949312 00000100:00100000:1.0:1787833919.302359:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381949312 00000100:00100000:1.0:1787833919.302428:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:1.0:1787833919.302439:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+67:11391:x1874679381949312:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833919.302459:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833919.302478:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dc32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed0c expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.302927:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dc39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.303210:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dc39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.303225:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dc39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833919.303274:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833919.303294:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dc39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.303342:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dc32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed0c expref: 69 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.303361:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dc39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed0c expref: 68 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.303371:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:1.0:1787833919.303374:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787833919.303378:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723600, rc 0) 00000100:00100000:1.0:1787833919.303451:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+68:11391:x1874679381949312:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1013us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833919.303460:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:2.0:1787833919.309546:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833919.309651:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381949440 00000100:00100000:0.0:1787833919.309660:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381949440 00000100:00100000:0.0:1787833919.309718:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:0.0:1787833919.309729:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2401:x1874679381949440:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833919.309938:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833919.309961:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed13 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833919.309998:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902e3f, blocks: 0x0 00010000:00010000:0.0:1787833919.310020:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=395s v=(0 0) 00010000:00010000:0.0:1787833919.310025:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833919.310035:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed13 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.310121:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed13 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.310285:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247c00, rc 0) 00000100:00100000:0.0:1787833919.310402:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+10:2401:x1874679381949440:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 674us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833919.310410:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:0.0:1787833919.315616:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833919.315725:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381949696 00000100:00100000:2.0:1787833919.315734:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381949696 00000100:00100000:2.0:1787833919.316085:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 135 00000100:00100000:2.0:1787833919.316096:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+68:11391:x1874679381949696:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787833919.316227:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+68:11391:x1874679381949696:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 133us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833919.316236:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 135 00000100:00100000:1.0:1787833919.318503:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833919.318526:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df61189e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406140928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833919.318599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833919.318680:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406140928 00000100:00100000:1.0:1787833919.318688:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406140928 00000100:00100000:1.0:1787833919.318735:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787833919.318743:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406140928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787833919.318807:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787833919.318855:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406140928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833919.318862:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787833919.318905:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df61189e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406140928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833919.324891:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.325027:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381949824 00000100:00100000:3.0:1787833919.325036:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381949824 00000100:00100000:3.0:1787833919.325094:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:3.0:1787833919.325108:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+10:11391:x1874679381949824:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833919.325125:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833919.325140:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed1a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.325204:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed13 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.325214:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833919.325219:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833919.325224:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.325255:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed13 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.325268:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed13 expref: 11 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833919.325282:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c16940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874679406141056:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833919.325356:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ffd29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833919.341142:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.341478:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c16940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874679406141056:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833919.341511:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.341555:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031000, rc 0) 00000100:00100000:3.0:1787833919.341615:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+11:11391:x1874679381949824:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 16507us (16730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833919.341625:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:1.0:1787833919.343717:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381949952 00000100:00100000:1.0:1787833919.343730:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381949952 00010000:00010000:1.0:1787833919.343966:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed13 expref: 11 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833919.344075:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:1.0:1787833919.344086:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e164450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2401:x1874679381949952:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833919.344101:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833919.344124:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed13 expref: 11 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.344139:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed13 expref: 11 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.344177:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1dc40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed13 expref: 11 pid: 8430 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.344192:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833919.344205:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833919.344213:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.344223:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.344257:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833919.344286:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df61189f0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6498:1874679406141184:192.168.203.17@tcp:105: 00000100:00100000:1.0:1787833919.344378:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833919.349113:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833919.349330:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381950080 00000100:00100000:0.0:1787833919.349339:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381950080 00002000:00100000:0.0:1787833919.349387:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8df504c16940 x1874679381950080/t0(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:725/0 lens 504/0 e 0 to 0 dl 1787833930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833919.349398:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504c16940 with x1874679381950080 ext(0->12) 00002000:00010000:0.0:1787833919.349403:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504c16940 00000100:00100000:0.0:1787833919.349434:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:0.0:1787833919.349444:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2401:x1874679381950080:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787833919.350893:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df61189f0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6498:1874679406141184:192.168.203.17@tcp:105: 00010000:00010000:1.0:1787833919.350917:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833919.350976:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e164450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+13:2401:x1874679381949952:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 6892us (9842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833919.350985:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:3.0:1787833919.352709:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+12:2401:x1874679381950080:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 Request processed in 3257us (3598us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787833919.352727:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00002000:00100000:3.0:1787833919.352738:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8df504c16940 x1874679381950080/t4294967309(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:725/0 lens 504/448 e 0 to 0 dl 1787833930 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833919.352748:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504c16940 with x1874679381950080 ext(0->12) 00002000:00010000:3.0:1787833919.352788:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504c16940 00000100:00100000:3.0:1787833919.359398:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833919.359702:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381950208 00000100:00100000:2.0:1787833919.359711:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381950208 00000100:00100000:3.0:1787833919.359884:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:3.0:1787833919.359896:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+68:11391:x1874679381950208:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787833919.362429:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1787833919.362447:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1787833919.362488:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:0.0:1787833919.362582:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362595:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362603:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362610:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.362615:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362634:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362651:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8df602ff4800) 00010000:00010000:0.0:1787833919.362654:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.362659:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362666:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1d94c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362693:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362700:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362705:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362710:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.362713:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362720:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362728:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8df503f02900) 00010000:00010000:0.0:1787833919.362730:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.362733:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362785:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1d9f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362816:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362823:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362829:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362833:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.362836:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362841:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362849:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f0e800) 00010000:00010000:0.0:1787833919.362852:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.362855:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362861:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1da72 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362871:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362877:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362890:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362895:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.362898:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362905:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362914:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df503f0e800) 00010000:00010000:0.0:1787833919.362916:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.362919:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362925:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1da95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362939:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362946:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362952:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362957:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.362960:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362976:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362985:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833919.362988:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.362992:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.362997:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1db67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.363007:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.363013:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.363019:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.363025:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.363028:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.363035:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.363042:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:0.0:1787833919.363057:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787833919.363061:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.363077:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dc24 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833919.363279:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df61189cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406141440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787833919.363347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833919.363382:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833919.363388:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df61189e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406141312:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787833919.363410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833919.363441:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406141440 00000100:00100000:1.0:1787833919.363447:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406141440 00000100:00100000:1.0:1787833919.363496:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406141312 00000100:00100000:1.0:1787833919.363499:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406141312 00000100:00100000:1.0:1787833919.363519:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787833919.363527:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1874679406141440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787833919.363653:0:8583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787833919.363658:0:8583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787833919 00002000:00010000:1.0:1787833919.363660:0:8583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787833919.363663:0:8583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787833919 -> 1787833919 00002000:00010000:1.0:1787833919.363665:0:8583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787833919.363703:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3639:x1874679406141440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (355us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787833919.363718:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787833919.363735:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787833919.363741:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1874679406141312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787833919.363782:0:8583:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1787833919.363799:0:8583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.363820:0:8583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec72 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.363828:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787833919.363832:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833919.363836:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.363860:0:8583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec72 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.363875:0:8583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec72 expref: 11 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833919.363886:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df61189c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8583:1874679406141568:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833919.363949:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef9b000 going to sleep for 11 seconds 00000100:00080000:1.0:1787833919.363966:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787833919.363994:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df61189cf00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787833919.364005:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df61189cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406141440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787833919.367737:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833919.367783:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406141696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787833919.367864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833919.367908:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406141696 00000100:00100000:3.0:1787833919.367915:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406141696 00000100:00100000:3.0:1787833919.367962:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787833919.367972:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c5cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3641:x1874679406141696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787833919.367999:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1787833919.368042:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a902e3d, atime: 0x6a902e3e, ctime: 0x6a902e3d, blocks: 0x8 00010000:00010000:3.0:1787833919.368341:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.368357:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1787833919.368362:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833919.368369:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.368385:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.368395:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.368404:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.368429:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787833919.368574:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c5cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3641:x1874679406141696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 603us (708us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787833919.368583:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1787833919.368632:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df504c170c0/2, rc 0, transno 4294967305 00000100:00100000:3.0:1787833919.368639:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406141696:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1787833919.368654:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1787833919.368769:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df6112ee240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787833919.368775:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df503f32300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df63c3e7900 00000020:00080000:2.0:1787833919.368778:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df503f32400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df60530da00 00000020:00080000:2.0:1787833919.368836:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df63b1a8f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787833919.368841:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df502441400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df63b1a8b40 00000020:00080000:2.0:1787833919.368844:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df502441a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df504463200 00000020:00080000:2.0:1787833919.368858:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:2.0:1787833919.368880:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833919.368887:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.368897:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833919.368901:0:7455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.368911:0:7455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.368930:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.368937:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e32efafd/0x996d2fb20dc1dc55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.368959:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833919.368961:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833919.368973:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787833919.369312:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787833919.369359:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787833919.369644:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+16:11391:x1874679381950208:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 9746us (10253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833919.369655:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:0.0:1787833919.372140:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.372168:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df61189c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8583:1874679406141568:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833919.372205:0:8583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833919.372330:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381950336 00000100:00100000:3.0:1787833919.372337:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381950336 00010000:00010000:3.0:1787833919.372374:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec72 expref: 12 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833919.372416:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:3.0:1787833919.372426:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504786d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+12:2400:x1874679381950336:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833919.372441:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833919.372446:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec72 expref: 12 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.372459:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec72 expref: 12 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.372481:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008131d7c2/0x996d2fb20dc1da02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec72 expref: 12 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.372496:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833919.372501:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833919.372506:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.372516:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.372562:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833919.372615:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504786d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2400:x1874679381950336:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 190us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833919.372623:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 74 00010000:00010000:1.0:1787833919.372679:0:8583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.372688:0:8583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.372698:0:8583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.372706:0:8583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.372729:0:8583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787833919.372925:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3639:x1874679406141312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9183us (9512us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787833919.372933:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1787833919.372949:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df61189e1c0/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787833919.372954:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df61189e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406141312:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787833919.373326:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833919.373335:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.373344:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787833919.373348:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.374413:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.374440:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.374447:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009957b9b/0x996d2fb20dc1dc4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.374469:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833919.374471:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833919.374472:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833919.380352:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.380455:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381950464 00000100:00100000:1.0:1787833919.380465:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381950464 00000100:00100000:1.0:1787833919.380520:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:1.0:1787833919.380530:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504787c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2400:x1874679381950464:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787833919.382875:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1787833919.382888:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1787833919.383325:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504787c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381950464:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 2790us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833919.383347:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:0.0:1787833919.386450:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.386714:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381950720 00000100:00100000:1.0:1787833919.386725:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381950720 00000100:00100000:1.0:1787833919.386875:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:1.0:1787833919.386887:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504785a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+16:11391:x1874679381950720:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787833919.386941:0:9772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833919.386969:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dc39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed0c expref: 16 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.386988:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:1.0:1787833919.386993:0:9772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833919.387022:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.387035:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.387062:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833919.387186:0:9772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007053599c reply state 000000004b13aa88 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.387209:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.387216:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:1.0:1787833919.387219:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833919.387231:0:9772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833919.387332:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504785a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+17:11391:x1874679381950720:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 447us (893us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787833919.387340:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:2.0:1787833919.391996:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.392137:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381950848 00000100:00100000:3.0:1787833919.392147:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381950848 00000100:00100000:3.0:1787833919.392239:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:3.0:1787833919.392250:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381950848:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787833919.392414:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787833919.392418:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787833919 -> 1787833918 00002000:00010000:3.0:1787833919.392420:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787833918 00002000:00010000:3.0:1787833919.392422:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787833919 -> 1787833918 00002000:00010000:3.0:1787833919.392424:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787833919.392485:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381950848:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 236us (496us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787833919.392493:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:2.0:1787833919.396793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833919.396919:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381951104 00000100:00100000:0.0:1787833919.396928:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381951104 00000100:00100000:0.0:1787833919.397029:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:0.0:1787833919.397041:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+17:11391:x1874679381951104:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787833919.397117:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.397135:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecfe expref: 17 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.397145:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.397189:0:13407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecfe expref: 17 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.397212:0:13407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecfe expref: 17 pid: 13407 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833919.397246:0:13407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047861c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406141824:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833919.397326:0:13407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833919.408873:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.409085:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381951232 00000100:00100000:1.0:1787833919.409094:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381951232 00010000:00010000:1.0:1787833919.409133:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecfe expref: 18 pid: 13407 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833919.409428:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00100000:1.0:1787833919.409440:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+18:2400:x1874679381951232:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833919.409456:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833919.409463:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecfe expref: 18 pid: 13407 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.409476:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecfe expref: 18 pid: 13407 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.409498:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:1.0:1787833919.409504:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.409513:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.409521:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.409550:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833919.409610:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+18:2400:x1874679381951232:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 174us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833919.409640:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 75 00010000:00010000:2.0:1787833919.409723:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dc1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecfe expref: 17 pid: 13407 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833919.409741:0:13407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047861c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406141824:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833919.409816:0:13407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.409826:0:13407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.409832:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.409870:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.409878:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.409885:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.409891:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833919.409895:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.409913:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.409922:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:2.0:1787833919.409925:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787833919.409928:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.409933:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc63 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833919.409972:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+16:11391:x1874679381951104:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 Request processed in 12934us (13352us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787833919.409980:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:2.0:1787833919.418168:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.418303:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381951360 00000100:00100000:3.0:1787833919.418312:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381951360 00000100:00100000:3.0:1787833919.418377:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:3.0:1787833919.418388:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2401:x1874679381951360:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787833919.418438:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.418461:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.418468:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833919.418472:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833919.418477:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.418512:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.418553:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 7 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833919.418567:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1874679406141952:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833919.418649:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ffd29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833919.421492:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1874679406141952:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833919.421519:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833919.424153:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.424261:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381951488 00000100:00100000:3.0:1787833919.424271:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381951488 00010000:00010000:3.0:1787833919.424310:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 8 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833919.424352:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:3.0:1787833919.424361:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381951488:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833919.424377:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833919.424397:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 8 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.424417:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 8 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.424438:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1dc47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed1a expref: 8 pid: 8431 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.424472:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833919.424476:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833919.424481:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.424490:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.424526:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833919.424587:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381951488:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 227us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833919.424596:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 76 00010000:00010000:0.0:1787833919.424822:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.424832:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.424850:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.424859:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.424866:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.424872:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787833919.424876:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.424886:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.424911:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.424920:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000896f1ed7/0x996d2fb20dc1dc6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833919.424983:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381951360:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 6597us (6831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833919.424992:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:2.0:1787833919.427996:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.428079:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381951744 00000100:00100000:3.0:1787833919.428089:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381951744 00000100:00100000:3.0:1787833919.428152:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 139 00000100:00100000:3.0:1787833919.428163:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+16:11391:x1874679381951744:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787833919.428243:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.428260:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecc6 expref: 16 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.428270:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.428305:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecc6 expref: 16 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.428334:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecc6 expref: 16 pid: 9772 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833919.428348:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406142080:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833919.428467:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ffd29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833919.435427:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.435543:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381951872 00000100:00100000:1.0:1787833919.435552:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381951872 00010000:00010000:1.0:1787833919.435593:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecc6 expref: 17 pid: 9772 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833919.435634:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:1.0:1787833919.435644:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+17:2400:x1874679381951872:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833919.435658:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833919.435665:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecc6 expref: 17 pid: 9772 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.435679:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecc6 expref: 17 pid: 9772 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.435701:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:1.0:1787833919.435707:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece9 expref: 17 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.435717:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.435724:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.435732:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833919.435795:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833919.435854:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+17:2400:x1874679381951872:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 211us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833919.435862:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 77 00010000:00010000:0.0:1787833919.437420:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1db60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ecc6 expref: 16 pid: 9772 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833919.437443:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406142080:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833919.437467:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.437477:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.437483:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.437652:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.437665:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed05 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.437691:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.437724:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed05 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.437741:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed05 expref: 16 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833919.437898:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406142208:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833919.437986:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833919.441333:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833919.441410:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381952000 00000100:00100000:3.0:1787833919.441418:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381952000 00010000:00010000:3.0:1787833919.441460:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed05 expref: 17 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833919.441500:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:3.0:1787833919.441509:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+17:2400:x1874679381952000:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833919.441522:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833919.441528:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed05 expref: 17 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.441542:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed05 expref: 17 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.441564:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:3.0:1787833919.441569:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.441578:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.441602:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.441619:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833919.441681:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+17:2400:x1874679381952000:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 172us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833919.441688:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 78 00010000:00010000:0.0:1787833919.442941:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1dc2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed05 expref: 16 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833919.442962:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406142208:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833919.442984:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.442992:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.442998:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833919.443226:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1787833919.443340:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1787833919.443375:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1787833919.443469:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6515:1874679406142336:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787833919.443528:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833919.443621:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6078f69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833919.443668:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406142336 00000100:00100000:1.0:1787833919.443675:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406142336 00000100:00100000:1.0:1787833919.443861:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787833919.443872:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1874679406142336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787833919.443950:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1874679406142336:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833919.443956:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787833919.444064:0:6515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1787833919.444070:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1787833919.444084:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df61189cf00, transno 4294967310 00000004:00080000:0.0:1787833919.444093:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df61189e1c0, transno 4294967311 00000100:00100000:0.0:1787833919.444099:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6515:1874679406142336:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787833919.444212:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1787833919.444252:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6515:1874679406142464:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787833919.444279:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833919.445309:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833919.445412:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406142464 00000100:00100000:2.0:1787833919.445419:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406142464 00000100:00100000:2.0:1787833919.445458:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787833919.445466:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1874679406142464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787833919.445637:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1874679406142464:12345-0@lo:1000:mdt00_002.0 Request processed in 170us (1355us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787833919.445643:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787833919.445943:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6515:1874679406142464:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787833919.445984:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.445994:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446003:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446008:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.446013:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446022:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446039:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:0.0:1787833919.446119:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833919.446124:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446132:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dc78 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446154:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446161:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446167:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446172:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.446175:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446181:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446190:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833919.446192:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833919.446210:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece9 expref: 19 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446222:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece9 expref: 19 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446306:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece9 expref: 19 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.446345:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece9 expref: 19 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833919.446360:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f40f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406142592:192.168.203.17@tcp:105: 00000100:00100000:0.0:1787833919.446475:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e73cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833919.449730:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.450039:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381952128 00000100:00100000:1.0:1787833919.450057:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381952128 00000100:00100000:1.0:1787833919.450108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:1.0:1787833919.450117:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+20:11390:x1874679381952128:12345-192.168.203.17@tcp:49:lfs.0 00000100:00100000:1.0:1787833919.450251:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+20:11390:x1874679381952128:12345-192.168.203.17@tcp:49:lfs.0 Request processed in 134us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833919.450258:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:0.0:1787833919.450376:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f40f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406142592:192.168.203.17@tcp:105: 00010000:00010000:0.0:1787833919.450399:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450410:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1dbbb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450441:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450455:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450466:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450476:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450482:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450488:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450513:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.450516:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450523:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450535:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833919.450537:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.450541:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450547:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dc7f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450557:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450562:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450568:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450572:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.450576:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450582:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450599:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833919.450602:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787833919.450605:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.450610:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1dc71 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833919.450737:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+19:11391:x1874679381951744:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 22575us (22748us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787833919.450746:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 139 00000020:00080000:0.0:1787833919.450781:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787833919.453113:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833919.453122:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833919.453988:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787833919.453999:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833919.460494:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.460550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833919.460639:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381952384 00000100:00100000:0.0:1787833919.460648:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381952384 00000100:00100000:0.0:1787833919.460715:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 140 00000100:00100000:0.0:1787833919.460726:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+19:11390:x1874679381952384:12345-192.168.203.17@tcp:58:lfs.0 00000040:00080000:0.0:1787833919.460918:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787833919.460998:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+19:11390:x1874679381952384:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 273us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833919.461005:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 140 00000100:00100000:3.0:1787833919.465738:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381952640 00000100:00100000:3.0:1787833919.465779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381952640 00000100:00100000:3.0:1787833919.465855:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:3.0:1787833919.465867:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df610442c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+19:11391:x1874679381952640:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787833919.466140:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787833919.466174:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1787833919.466912:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.466931:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.466942:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.466950:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.466957:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.466963:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833919.467002:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833919.467911:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833919.467932:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.467941:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833919.467945:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.467954:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.467969:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:2.0:1787833919.467972:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787833919.467977:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.467983:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dc86 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.468000:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833919.468003:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833919.468004:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833919.472872:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df610442c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+21:11391:x1874679381952640:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 6995us (12308us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787833919.472887:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00000020:00080000:2.0:1787833919.472895:0:6517:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787833919.495255:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833919.495393:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381952768 00000100:00100000:2.0:1787833919.495403:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381952768 00000100:00100000:2.0:1787833919.495464:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:2.0:1787833919.495474:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+21:11393:x1874679381952768:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833919.495512:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833919.495531:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dc8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed21 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495628:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495642:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495653:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495667:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495675:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495681:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495804:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495816:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece2 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495824:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495856:0:13407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece2 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.495881:0:13407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece2 expref: 22 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833919.495896:0:13407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059ea940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406142720:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833919.495983:0:13407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787833919.501479:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833919.501818:0:13407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059ea940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406142720:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833919.501844:0:13407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833919.502013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381953024 00000100:00100000:3.0:1787833919.502020:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381953024 00000100:00100000:3.0:1787833919.503649:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:3.0:1787833919.503668:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+23:6172:x1874679381953024:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787833919.504132:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+24:6172:x1874679381953024:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 472us (2659us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787833919.504141:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:3.0:1787833919.508499:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833919.509019:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381953152 00000100:00100000:1.0:1787833919.509029:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381953152 00010000:00010000:2.0:1787833919.509397:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece2 expref: 24 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833919.509479:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:2.0:1787833919.509490:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+24:2401:x1874679381953152:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833919.509506:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833919.509512:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece2 expref: 24 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.509525:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece2 expref: 24 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.509546:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dbad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece2 expref: 24 pid: 6515 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.509561:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:2.0:1787833919.509578:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.509588:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.509595:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833919.509668:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833919.509728:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+23:2401:x1874679381953152:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 240us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833919.509735:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 79 00010000:00010000:0.0:1787833919.511034:0:13407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511063:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833919.511129:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787833919.511134:0:13407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833919.511181:0:13407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511205:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511216:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511222:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511228:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511233:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.511237:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511244:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511258:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833919.511260:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.511265:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511272:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dc94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511286:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511291:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511302:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511307:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833919.511310:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511316:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511324:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8df608e13b00) 00010000:00010000:0.0:1787833919.511326:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833919.511329:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511336:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dc9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511378:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dc8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed21 expref: 23 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511394:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed21 expref: 22 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833919.511400:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833919.511402:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833919.511405:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:0.0:1787833919.511469:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11393:x1874679381952768:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 15996us (16221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833919.511486:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 141 00010000:00010000:2.0:1787833920.290893:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787833920.473777:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833920.473786:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833920.473812:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787833920.473821:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833920.475109:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059ea940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406142848:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787833920.475432:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6078f6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787833920.482294:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059ea940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406142848:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787833920.490611:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833920.490696:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381953280 00000100:00100000:0.0:1787833920.490707:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381953280 00000100:00080000:3.0:1787833920.491103:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833920.491120:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:0.0:1787833920.491130:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11404:x1874679381953280:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787833920.491172:0:6515:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787833920.491302:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11404:x1874679381953280:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 174us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833920.491307:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:2.0:1787833920.496707:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833920.496784:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381953536 00000100:00100000:2.0:1787833920.496794:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381953536 00000100:00100000:2.0:1787833920.496859:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 143 00000100:00100000:2.0:1787833920.496870:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+22:11404:x1874679381953536:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833920.496890:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833920.496909:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dca9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed28 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833920.497030:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dcb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833920.497046:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833920.497059:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833920.497070:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787833920.497178:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dca9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed28 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833920.497206:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dcb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed28 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833920.497216:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:2.0:1787833920.497219:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833920.497223:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4fe00, rc 0) 00000100:00100000:2.0:1787833920.497283:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+24:11404:x1874679381953536:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 415us (587us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787833920.497291:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 143 00000040:00080000:3.0:1787833920.498479:0:14259:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833920.498486:0:14259:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833920.498518:0:14259:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787833920.498526:0:14259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833920.513500:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833920.513982:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381953664 00000100:00100000:1.0:1787833920.513993:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381953664 00000100:00100000:0.0:1787833920.514311:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1787833920.514322:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e165050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+24:2398:x1874679381953664:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833920.514411:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833920.514436:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dcb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed28 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833920.514453:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833920.514457:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833920.514510:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e165050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+23:2398:x1874679381953664:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 191us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833920.514518:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:1.0:1787833920.530350:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833920.530403:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381953920 00000100:00100000:1.0:1787833920.530412:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381953920 00000100:00100000:1.0:1787833920.530468:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 144 00000100:00100000:1.0:1787833920.530481:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+23:11404:x1874679381953920:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787833920.530562:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833920.530580:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833920.530593:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833920.530742:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833920.531397:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833920.531406:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833920.531413:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833920.531418:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833920.531437:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833920.531452:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:1.0:1787833920.531455:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787833920.531461:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833920.531468:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dcbe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833920.531635:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+24:11404:x1874679381953920:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 1154us (1289us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787833920.531644:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 144 00000040:00080000:2.0:1787833920.531876:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833920.531882:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833920.533455:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787833920.533470:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787833920.546887:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833920.547137:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381954176 00000100:00100000:1.0:1787833920.547148:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381954176 00000100:00100000:1.0:1787833920.547230:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:1.0:1787833920.547241:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+24:11404:x1874679381954176:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787833920.547839:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+25:11404:x1874679381954176:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 597us (958us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787833920.547848:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:2.0:1787833920.854886:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833920.855071:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406142976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833920.855238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833920.855299:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406142976 00000100:00100000:1.0:1787833920.855309:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406142976 00000100:00080000:0.0:1787833920.855342:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833920.855376:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787833920.855389:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406142976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833920.855420:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1787833920.855495:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406142976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833920.855511:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787833920.855630:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833920.855640:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406143104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833920.855671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833920.855721:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406143104 00000100:00100000:0.0:1787833920.855725:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406143104 00000100:00100000:0.0:1787833920.855783:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787833920.855792:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406143104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833920.855804:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787833920.855845:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406143104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833920.855852:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787833920.855885:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406143104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833920.856439:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406142976:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1787833920.860201:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1787833920.860218:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:3.0:1787833921.305260:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833921.590551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833921.590599:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833921.590637:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833921.590656:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833921.590673:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833921.590691:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833921.590712:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833921.590890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381954560 00000100:00100000:2.0:1787833921.590900:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381954560 00000100:00100000:2.0:1787833921.590966:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381955072 00000100:00100000:2.0:1787833921.590969:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381955072 00000100:00100000:2.0:1787833921.590983:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381954432 00000100:00100000:2.0:1787833921.590985:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381954432 00000100:00100000:2.0:1787833921.590994:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381954944 00000100:00100000:2.0:1787833921.590996:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381954944 00000100:00100000:2.0:1787833921.591012:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 308 00000100:00100000:2.0:1787833921.591021:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381954560:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833921.591095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381954560:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 74us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833921.591102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 308 00000100:00100000:2.0:1787833921.591120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 309 00000100:00100000:2.0:1787833921.591126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502511680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381955072:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833921.591165:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502511680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381955072:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 38us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833921.591172:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 309 00000100:00100000:2.0:1787833921.591195:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 310 00000100:00100000:2.0:1787833921.591202:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+25:2399:x1874679381954432:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833921.591229:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+25:2399:x1874679381954432:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833921.591251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 310 00000100:00100000:2.0:1787833921.591264:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 311 00000100:00100000:2.0:1787833921.591271:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381954944:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833921.591295:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381954944:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 25us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833921.591301:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 311 00000100:00100000:3.0:1787833921.591356:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381954304 00000100:00100000:3.0:1787833921.591362:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381954304 00000100:00100000:3.0:1787833921.591406:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 387 00000100:00100000:3.0:1787833921.591418:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381954304:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833921.591454:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381954304:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 41us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833921.591462:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 387 00000100:00100000:3.0:1787833921.591495:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381954816 00000100:00100000:3.0:1787833921.591499:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381954816 00000100:00080000:0.0:1787833921.591565:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833921.591570:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833921.591573:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833921.591608:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381954688 00000100:00100000:0.0:1787833921.591613:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381954688 00000100:00080000:1.0:1787833921.591641:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833921.591658:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:0.0:1787833921.591673:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381954688:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833921.591702:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381954688:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833921.595402:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:3.0:1787833921.602214:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:3.0:1787833921.602252:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381954816:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833921.602343:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381954816:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 102us (11704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833921.602350:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 115 00010000:00010000:3.0:1787833922.325987:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787833922.343378:0:14310:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833922.343388:0:14310:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833922.343426:0:14310:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787833922.343433:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787833922.585317:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833922.585425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381955328 00000100:00100000:2.0:1787833922.585435:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381955328 00000100:00100000:2.0:1787833922.585519:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 145 00000100:00100000:2.0:1787833922.585530:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+25:11425:x1874679381955328:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833922.585552:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833922.585573:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dcc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833922.585681:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dccc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833922.585696:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dccc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833922.585709:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dccc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833922.585721:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787833922.585863:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dcc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed2f expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833922.585903:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dccc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed2f expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833922.585912:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:2.0:1787833922.585915:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787833922.585918:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4fe00, rc 0) 00000100:00100000:2.0:1787833922.585982:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+27:11425:x1874679381955328:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 454us (674us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787833922.585990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 145 00000100:00080000:1.0:1787833922.586262:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833922.589933:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833922.590037:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381955456 00000100:00100000:1.0:1787833922.590047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381955456 00000100:00100000:1.0:1787833922.590137:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:1.0:1787833922.590148:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+27:11425:x1874679381955456:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1787833922.590222:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.590239:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.590252:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.590288:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.590295:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.590301:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.590326:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833922.590330:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.590338:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.590349:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:1.0:1787833922.590352:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833922.590357:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.590363:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1dcda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833922.590434:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+27:11425:x1874679381955456:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 288us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833922.590440:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:0.0:1787833922.646166:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833922.646356:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381955584 00000100:00100000:1.0:1787833922.646365:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381955584 00000100:00100000:1.0:1787833922.646426:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:1.0:1787833922.646435:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381955584:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:1.0:1787833922.646453:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833922.646472:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c84445ef/0x996d2fb20dc1dce1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed36 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787833922.646509:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a902e3e, atime: 0x6a902e3e, ctime: 0x6a902e3e, blocks: 0x8 00010000:00010000:1.0:1787833922.646530:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1787833922.646541:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833922.646551:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c84445ef/0x996d2fb20dc1dce1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed36 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.646571:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c84445ef/0x996d2fb20dc1dce1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed36 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833922.646585:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723600, rc 0) 00000100:00100000:1.0:1787833922.646651:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381955584:12345-192.168.203.17@tcp:101:cat.0 Request processed in 217us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833922.646659:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:3.0:1787833922.649452:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833922.649552:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381955712 00000100:00100000:1.0:1787833922.649560:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381955712 00002000:00100000:1.0:1787833922.649607:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8df504c14b40 x1874679381955712/t0(0) o3->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:728/0 lens 488/0 e 0 to 0 dl 1787833933 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787833922.649617:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504c14b40 with x1874679381955712 ext(0->4095) 00002000:00010000:1.0:1787833922.649623:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504c14b40 00000100:00100000:0.0:1787833922.649796:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:0.0:1787833922.649808:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2401:x1874679381955712:12345-192.168.203.17@tcp:3:cat.0 00000100:00100000:0.0:1787833922.650141:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2401:x1874679381955712:12345-192.168.203.17@tcp:3:cat.0 Request processed in 334us (692us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787833922.650150:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00002000:00100000:0.0:1787833922.650167:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8df504c14b40 x1874679381955712/t0(0) o3->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:728/0 lens 488/4536 e 0 to 0 dl 1787833933 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833922.650183:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504c14b40 with x1874679381955712 ext(0->4095) 00002000:00010000:0.0:1787833922.650187:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504c14b40 00000100:00100000:1.0:1787833922.902184:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406143232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833922.902257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833922.902481:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406143232 00000100:00100000:2.0:1787833922.902489:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406143232 00000100:00100000:2.0:1787833922.902543:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787833922.902554:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406143232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833922.902586:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833922.902644:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406143232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833922.902652:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787833922.902736:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406143232:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787833923.353774:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833923.414262:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406143744:0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833923.414405:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406144256:0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414430:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833923.414450:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504485680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406144768:0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833923.414498:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787833923.414504:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504572580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406143616:0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833923.414539:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635b38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406144128:0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833923.414574:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406144640:0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833923.414644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406144256 00000100:00100000:0.0:1787833923.414652:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406144256 00000100:00100000:0.0:1787833923.414704:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406144768 00000100:00100000:0.0:1787833923.414707:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406144768 00000100:00100000:0.0:1787833923.414719:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406143616 00000100:00100000:0.0:1787833923.414721:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406143616 00000100:00100000:0.0:1787833923.414731:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406144128 00000100:00100000:0.0:1787833923.414733:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406144128 00000100:00100000:0.0:1787833923.414745:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406144640 00000100:00100000:0.0:1787833923.414747:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406144640 00000100:00100000:0.0:1787833923.414786:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787833923.414795:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406144256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414844:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406144256:12345-0@lo:400:kworker.0 Request processed in 49us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833923.414850:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787833923.414867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787833923.414872:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406144768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414898:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406144768:12345-0@lo:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833923.414904:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787833923.414916:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787833923.414922:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406143616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414947:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406143616:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833923.414952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787833923.414962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787833923.414967:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406144128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.414989:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406144128:12345-0@lo:400:kworker.0 Request processed in 22us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833923.415001:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787833923.415013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787833923.415018:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406144640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.415044:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406144640:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833923.415051:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:0.0:1787833923.415072:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833923.415076:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833923.415102:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504572580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406143616:0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.415112:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635b38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406144128:0@lo:400:kworker.0 00000100:00100000:0.0:1787833923.415121:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406144640:0@lo:400:kworker.0 00010000:00080000:0.0:1787833923.415132:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb87840 x1874679406144256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833923.415142:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406144256:0@lo:400:kworker.0 00010000:00080000:0.0:1787833923.415150:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504485680 x1874679406144768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833923.415156:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504485680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406144768:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.415453:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406143488:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.415488:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833923.415523:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406144000:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.415552:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833923.415569:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6205121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406144512:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.415592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833923.415616:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406145024:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.415637:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833923.415655:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787833923.415661:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406143360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833923.415682:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833923.415698:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406143872:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.415720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833923.415733:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406144384:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.415769:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833923.415786:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406144896:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.415806:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833923.415833:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406144512 00000100:00100000:1.0:1787833923.415837:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406144512 00000100:00100000:1.0:1787833923.415868:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406145024 00000100:00100000:1.0:1787833923.415871:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406145024 00000100:00100000:1.0:1787833923.415883:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406144384 00000100:00100000:1.0:1787833923.415885:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406144384 00000100:00100000:1.0:1787833923.415894:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406144896 00000100:00100000:1.0:1787833923.415896:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406144896 00000100:00100000:1.0:1787833923.415908:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787833923.415914:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406144512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.415952:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406144512:12345-0@lo:400:kworker.0 Request processed in 38us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833923.415958:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787833923.415972:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787833923.415978:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406145024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.416005:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406145024:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833923.416017:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787833923.416029:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787833923.416034:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406144384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.416061:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406144384:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833923.416066:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787833923.416077:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787833923.416084:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406144896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.416111:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406144896:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833923.416116:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787833923.416141:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406144384:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.416149:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406144896:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.416157:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6205121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406144512:0@lo:400:kworker.0 00000100:00100000:1.0:1787833923.416164:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787833923.416182:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1787833923.416198:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df5045a9680, transno 4294967302 00000004:00080000:1.0:1787833923.416206:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1787833923.416217:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df504c170c0, transno 4294967305 00000100:00100000:1.0:1787833923.416221:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406145024:0@lo:400:kworker.0 00000100:00100000:3.0:1787833923.416344:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406143744 00000100:00100000:3.0:1787833923.416348:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406143744 00000100:00100000:3.0:1787833923.416378:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406144000 00000100:00100000:3.0:1787833923.416380:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406144000 00000100:00100000:3.0:1787833923.416392:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787833923.416398:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406143744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833923.416437:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406143744:12345-0@lo:400:kworker.0 Request processed in 39us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833923.416442:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787833923.416453:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787833923.416458:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406144000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833923.416483:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406144000:12345-0@lo:400:kworker.0 Request processed in 25us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833923.416488:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787833923.416502:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406143872 00000100:00100000:3.0:1787833923.416504:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406143872 00000100:00100000:3.0:1787833923.416524:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787833923.416529:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406143872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833923.416554:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406143872:12345-0@lo:400:kworker.0 Request processed in 25us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833923.416568:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787833923.416711:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406143872:0@lo:400:kworker.0 00000100:00100000:3.0:1787833923.416720:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406144000:0@lo:400:kworker.0 00000100:00100000:3.0:1787833923.416745:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406143744:0@lo:400:kworker.0 00000100:00100000:2.0:1787833923.417432:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406143488 00000100:00100000:2.0:1787833923.417439:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406143488 00000100:00100000:2.0:1787833923.417483:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787833923.417492:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406143488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833923.417549:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406143488:12345-0@lo:400:kworker.0 Request processed in 58us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833923.417555:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787833923.417822:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406143360 00000100:00100000:0.0:1787833923.417826:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406143360 00000100:00100000:0.0:1787833923.417853:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787833923.417860:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406143360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833923.417881:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833923.417917:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406143360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833923.417928:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1787833923.417952:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833923.417957:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833923.418025:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406145152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833923.418060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833923.418192:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406145152 00000100:00100000:0.0:1787833923.418196:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406145152 00000100:00100000:0.0:1787833923.418229:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787833923.418236:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406145152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787833923.418246:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833923.418279:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406145152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833923.418285:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787833923.418330:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406145152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833923.419361:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406143360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833923.419375:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406143488:0@lo:400:kworker.0 00010000:00010000:3.0:1787833924.374037:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833924.437968:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406145280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787833924.438039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833924.438174:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406145280 00000100:00100000:0.0:1787833924.438182:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406145280 00000100:00100000:0.0:1787833924.438233:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787833924.438242:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406145280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833924.438275:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787833924.443430:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406145280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5179us (5381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833924.443445:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787833924.446553:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502f94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406145280:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1787833924.961938:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1787833924.961953:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787833924.962069:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1787833924.962105:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df6078f6240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787833924.962110:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df632a85a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df6078f69c0 00000020:00080000:0.0:1787833924.962114:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df632a85300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df602597200 00000020:00080000:0.0:1787833924.962134:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787833924.962198:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787833924.962265:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787833924.962677:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833924.962689:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833924.962705:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833924.962710:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833924.962715:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833924.962722:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833924.962736:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8df608e13400) 00010000:00010000:1.0:1787833924.962739:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833924.962743:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833924.963180:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dc5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787833925.079982:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787833925.406636:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787833925.654898:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833925.654906:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833925.654928:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787833925.654937:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833925.974572:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406145408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787833925.974645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833925.974813:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406145408 00000100:00100000:0.0:1787833925.974821:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406145408 00000100:00100000:0.0:1787833925.974891:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787833925.974901:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406145408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833925.974929:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787833925.974986:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406145408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833925.975007:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1787833925.975468:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833925.975940:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5044852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406145408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787833925.976838:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406145536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833925.976893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833925.977042:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406145536 00000100:00100000:2.0:1787833925.977048:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406145536 00000100:00080000:0.0:1787833925.977306:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833925.977530:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787833925.977543:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406145536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833925.977568:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787833925.977625:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406145536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833925.977690:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1787833925.977697:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1787833925.977720:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406145536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833925.982553:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00010000:2.0:1787833926.426209:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833926.708669:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833926.708707:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833926.708769:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833926.708793:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833926.708813:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833926.708832:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833926.708853:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833926.708881:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381956096 00000100:00100000:0.0:1787833926.708891:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381956096 00000100:00100000:0.0:1787833926.708951:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381956608 00000100:00100000:0.0:1787833926.708954:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381956608 00000100:00100000:0.0:1787833926.708970:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381955968 00000100:00100000:0.0:1787833926.708973:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381955968 00000100:00100000:0.0:1787833926.708987:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381956480 00000100:00100000:0.0:1787833926.708990:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381956480 00000100:00100000:0.0:1787833926.709022:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 318 00000100:00100000:0.0:1787833926.709032:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381956096:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833926.709102:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381956096:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 71us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833926.709110:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 318 00000100:00100000:0.0:1787833926.709140:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 319 00000100:00100000:0.0:1787833926.709155:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381956608:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833926.709183:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5044852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381956608:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833926.709189:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 319 00000100:00100000:0.0:1787833926.709202:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 320 00000100:00100000:0.0:1787833926.709208:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+13:2398:x1874679381955968:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833926.709232:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+13:2398:x1874679381955968:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833926.709238:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 320 00000100:00100000:0.0:1787833926.709250:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 321 00000100:00100000:0.0:1787833926.709257:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381956480:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833926.709281:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2398:x1874679381956480:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833926.709287:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 321 00000100:00080000:0.0:1787833926.709304:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833926.709308:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787833926.709381:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381956352 00000100:00100000:1.0:1787833926.709391:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381956352 00000100:00100000:1.0:1787833926.709432:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381956224 00000100:00100000:1.0:1787833926.709435:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381956224 00000100:00100000:1.0:1787833926.709459:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:1.0:1787833926.709466:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381956352:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833926.709495:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2398:x1874679381956352:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 30us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833926.709502:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:1.0:1787833926.709514:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:1.0:1787833926.709520:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2398:x1874679381956224:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833926.709544:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2398:x1874679381956224:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833926.709550:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00080000:0.0:1787833926.709813:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833926.709817:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833926.709929:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381955840 00000100:00100000:3.0:1787833926.709935:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381955840 00000100:00100000:3.0:1787833926.709975:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 389 00000100:00100000:3.0:1787833926.709982:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2398:x1874679381955840:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833926.710030:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2398:x1874679381955840:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 49us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833926.710037:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 389 00000100:00100000:2.0:1787833926.791256:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833926.791391:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381956736 00000100:00100000:0.0:1787833926.791400:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381956736 00000100:00100000:0.0:1787833926.791463:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 147 00000100:00100000:0.0:1787833926.791475:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+13:11078:x1874679381956736:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787833926.791591:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+13:11078:x1874679381956736:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833926.791616:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 147 00000100:00100000:3.0:1787833926.793103:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833926.793645:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381956864 00000100:00100000:0.0:1787833926.793654:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381956864 00000100:00100000:0.0:1787833926.793709:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 148 00000100:00100000:0.0:1787833926.793718:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:11078:x1874679381956864:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787833926.793831:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:11078:x1874679381956864:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 Request processed in 114us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833926.793838:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 148 00000100:00100000:0.0:1787833926.795374:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833926.795452:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381957120 00000100:00100000:2.0:1787833926.795460:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381957120 00000100:00100000:2.0:1787833926.795511:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:2.0:1787833926.795521:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+13:11078:x1874679381957120:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787833926.795821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+14:11078:x1874679381957120:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 300us (451us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787833926.795828:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:2.0:1787833927.161919:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833927.162044:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381957248 00000100:00100000:3.0:1787833927.162053:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381957248 00000100:00100000:3.0:1787833927.162109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 149 00000100:00100000:3.0:1787833927.162118:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:11883:x1874679381957248:12345-192.168.203.17@tcp:101:lsof.0 00010000:00010000:3.0:1787833927.162139:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833927.162169:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1dce8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833927.162230:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833927.162244:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833927.162258:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833927.162301:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787833927.162305:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787833927.162342:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833927.162366:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1dce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed3d expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833927.162399:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed3d expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833927.162408:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:3.0:1787833927.162411:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833927.162414:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031200, rc 0) 00000100:00100000:3.0:1787833927.162482:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+6:11883:x1874679381957248:12345-192.168.203.17@tcp:101:lsof.0 Request processed in 365us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833927.162490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 149 00010000:00010000:3.0:1787833927.446055:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833928.022039:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504786d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406145664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833928.022112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.022272:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406145664 00000100:00100000:2.0:1787833928.022280:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406145664 00000100:00100000:2.0:1787833928.022333:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787833928.022342:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6205121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406145664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833928.022374:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833928.022439:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6205121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406145664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.022447:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787833928.022531:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504786d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406145664:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787833928.473031:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833928.534207:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833928.534231:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406145792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833928.534301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833928.534384:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406145792 00000100:00100000:0.0:1787833928.534391:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406145792 00000100:00100000:0.0:1787833928.534445:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787833928.534454:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406145792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787833928.534493:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833928.534537:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406145792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833928.534544:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1787833928.534563:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833928.534595:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406145792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833928.536243:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406145920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833928.536312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833928.536398:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406145920 00000100:00100000:0.0:1787833928.536415:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406145920 00000100:00100000:0.0:1787833928.536460:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787833928.536468:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406145920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833928.536486:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787833928.536564:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833928.538347:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406145920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1872us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833928.538360:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787833928.538845:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406146176:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.538881:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406146048:0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.538907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.538925:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833928.538954:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620512580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406146688:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.538964:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6205103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406146560:0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.538986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833928.539009:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406147200:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539015:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.539045:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406147072:0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.539045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833928.539075:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787833928.539081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833928.539086:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6205130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406146304:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539108:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787833928.539118:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.539130:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406146432:0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.539153:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620511680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406146816:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539171:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.539194:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406146944:0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.539202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.539225:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833928.539230:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406147328:0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.539263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.539266:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406146048 00000100:00100000:2.0:1787833928.539273:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406146048 00000100:00100000:1.0:1787833928.539298:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406146176 00000100:00100000:1.0:1787833928.539303:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406146176 00000100:00100000:1.0:1787833928.539338:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406146688 00000100:00100000:1.0:1787833928.539341:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406146688 00000100:00100000:1.0:1787833928.539362:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406147200 00000100:00100000:1.0:1787833928.539365:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406147200 00000100:00100000:1.0:1787833928.539391:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406146432 00000100:00100000:1.0:1787833928.539394:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406146432 00000100:00100000:1.0:1787833928.539403:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406146816 00000100:00100000:1.0:1787833928.539406:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406146816 00000100:00100000:1.0:1787833928.539416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406147328 00000100:00100000:1.0:1787833928.539418:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406147328 00000100:00100000:1.0:1787833928.539431:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787833928.539438:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406146176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539480:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787833928.539489:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406146048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.539497:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406146176:12345-0@lo:400:kworker.0 Request processed in 56us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833928.539505:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787833928.539522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787833928.539531:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406146688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539547:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406146048:12345-0@lo:400:kworker.0 Request processed in 59us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.539555:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787833928.539570:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406146688:12345-0@lo:400:kworker.0 Request processed in 40us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833928.539579:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787833928.539593:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406146560 00000100:00100000:1.0:1787833928.539597:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787833928.539599:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406146560 00000100:00100000:1.0:1787833928.539607:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406147200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539627:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406146304 00000100:00100000:2.0:1787833928.539631:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406146304 00000100:00100000:1.0:1787833928.539642:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503c0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406147200:12345-0@lo:400:kworker.0 Request processed in 36us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.539651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787833928.539661:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787833928.539670:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406146560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.539679:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787833928.539688:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406146432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539710:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406146560:12345-0@lo:400:kworker.0 Request processed in 42us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.539717:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787833928.539731:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406146432:12345-0@lo:400:kworker.0 Request processed in 44us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.539737:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787833928.539743:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787833928.539777:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406146304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.539787:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787833928.539796:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406146816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539813:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406146304:12345-0@lo:400:kworker.0 Request processed in 67us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.539820:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787833928.539837:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406146816:12345-0@lo:400:kworker.0 Request processed in 41us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.539843:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406147072 00000100:00100000:1.0:1787833928.539844:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787833928.539848:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406147072 00000100:00100000:1.0:1787833928.539861:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787833928.539870:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502510b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406147328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539880:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406146944 00000100:00100000:2.0:1787833928.539885:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406146944 00000100:00100000:1.0:1787833928.539904:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502510b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406147328:12345-0@lo:400:kworker.0 Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.539912:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787833928.539913:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787833928.539924:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406147072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.539941:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787833928.539951:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406146944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.539961:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406147072:12345-0@lo:400:kworker.0 Request processed in 40us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.539968:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787833928.539990:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406146944:12345-0@lo:400:kworker.0 Request processed in 41us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833928.539997:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1787833928.540006:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833928.540011:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787833928.540014:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833928.540047:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6205130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406146304:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.540048:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406146432:0@lo:400:kworker.0 00010000:00080000:1.0:1787833928.540074:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df620511680 x1874679406146816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833928.540100:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620511680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406146816:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.540383:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406146944:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.540392:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406146048:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.540399:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6205103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406146560:0@lo:400:kworker.0 00000100:00100000:2.0:1787833928.540414:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406147072:0@lo:400:kworker.0 00010000:00080000:1.0:1787833928.540641:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb9f480 x1874679406147328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833928.540653:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406147328:0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.540665:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406146176:0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.540676:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620512580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406146688:0@lo:400:kworker.0 00000100:00100000:1.0:1787833928.540686:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406147200:0@lo:400:kworker.0 00000100:00100000:3.0:1787833928.540712:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406145920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787833929.493937:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833929.560333:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833929.560358:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502512d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406147456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787833929.560422:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833929.560648:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406147456 00000100:00100000:0.0:1787833929.560656:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406147456 00000100:00100000:0.0:1787833929.560744:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787833929.560784:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406147456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833929.560817:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787833929.560863:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406147456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833929.560870:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787833929.560947:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502512d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406147456:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787833930.279484:0:14508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:32:09 (1787833929) 00010000:00010000:3.0:1787833930.517985:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833931.094443:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406147584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833931.094515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833931.094678:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406147584 00000100:00100000:0.0:1787833931.094686:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406147584 00000100:00100000:0.0:1787833931.094778:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787833931.094788:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406147584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833931.094817:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787833931.094863:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406147584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833931.094871:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1787833931.094966:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833931.095000:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406147584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833931.097191:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406147712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787833931.097252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833931.097422:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406147712 00000100:00100000:0.0:1787833931.097429:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406147712 00000100:00080000:2.0:1787833931.097520:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833931.102177:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787833931.102203:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406147712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833931.102246:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787833931.102336:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502512d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406147712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (5083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833931.102344:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787833931.102454:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406147712:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1787833931.104708:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1787833931.104721:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787833931.104813:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787833931.104825:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787833931.500083:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833931.500630:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381957504 00000100:00100000:1.0:1787833931.500640:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381957504 00000100:00080000:2.0:1787833931.500915:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833931.501099:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 150 00000100:00100000:1.0:1787833931.501119:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+13:12151:x1874679381957504:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833931.501144:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833931.501164:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1dcf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501230:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501245:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501258:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501285:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501293:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501300:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501394:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dd0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501404:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dd0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501411:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dd0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833931.501420:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787833931.501494:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501501:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501508:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501515:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833931.501519:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501537:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501560:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df63c0c5600) 00010000:00010000:1.0:1787833931.501563:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833931.501568:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501575:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1dcfd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501589:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501596:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501602:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501607:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833931.501610:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501616:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501622:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df503f0e100) 00010000:00010000:1.0:1787833931.501625:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833931.501628:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501643:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1dd04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501950:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1dcf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed44 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501965:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dd0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed44 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.501972:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:1.0:1787833931.501974:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833931.501977:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722200, rc 0) 00000100:00100000:1.0:1787833931.502047:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+15:12151:x1874679381957504:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 939us (1973us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787833931.502055:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 150 00000100:00100000:1.0:1787833931.513162:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833931.513209:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833931.513573:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381957632 00000100:00100000:2.0:1787833931.513586:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381957632 00000100:00100000:3.0:1787833931.513654:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381957760 00000100:00100000:3.0:1787833931.513660:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381957760 00000100:00100000:2.0:1787833931.513661:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 151 00000100:00100000:2.0:1787833931.513674:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+16:12151:x1874679381957632:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787833931.513716:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1787833931.513725:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+16:2399:x1874679381957760:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833931.513738:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833931.513810:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1dd0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed44 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833931.513828:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+15:12151:x1874679381957632:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 155us (672us total) trans 0 rc 0/0 00010000:00010000:3.0:1787833931.513829:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:3.0:1787833931.513837:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833931.513842:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 151 00000100:00100000:3.0:1787833931.513865:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+14:2399:x1874679381957760:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 141us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833931.513873:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:2.0:1787833931.516222:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833931.526511:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381957888 00000100:00100000:0.0:1787833931.526534:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381957888 00000100:00100000:0.0:1787833931.526618:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 152 00000100:00100000:0.0:1787833931.526632:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:12151:x1874679381957888:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787833931.526743:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:12151:x1874679381957888:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 115us (10529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833931.526765:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 152 00000100:00080000:2.0:1787833931.526853:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787833931.543230:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787833931.797980:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833931.797988:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833931.800207:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787833931.800229:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833931.828689:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833931.828741:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833931.828793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833931.828821:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833931.828840:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833931.828858:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833931.828897:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833931.828926:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381958400 00000100:00100000:3.0:1787833931.828935:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381958400 00000100:00100000:3.0:1787833931.829000:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381958528 00000100:00100000:3.0:1787833931.829003:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381958528 00000100:00100000:3.0:1787833931.829030:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:3.0:1787833931.829040:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381958400:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833931.829123:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2399:x1874679381958400:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 84us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833931.829144:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:3.0:1787833931.829163:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:3.0:1787833931.829169:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381958528:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833931.829194:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381958528:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833931.829199:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:3.0:1787833931.829217:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381958144 00000100:00100000:3.0:1787833931.829220:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381958144 00000100:00100000:3.0:1787833931.829241:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381958656 00000100:00100000:3.0:1787833931.829243:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381958656 00000100:00100000:3.0:1787833931.829254:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381958272 00000100:00100000:3.0:1787833931.829256:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381958272 00000100:00100000:3.0:1787833931.829265:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381958784 00000100:00100000:3.0:1787833931.829267:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381958784 00000100:00100000:3.0:1787833931.829280:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 328 00000100:00100000:3.0:1787833931.829285:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+14:2399:x1874679381958144:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833931.829310:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+14:2399:x1874679381958144:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833931.829316:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 328 00000100:00100000:3.0:1787833931.829328:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 329 00000100:00100000:3.0:1787833931.829334:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2399:x1874679381958656:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833931.829356:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2399:x1874679381958656:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833931.829362:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 329 00000100:00100000:3.0:1787833931.829373:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 330 00000100:00100000:3.0:1787833931.829385:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381958272:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833931.829411:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381958272:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833931.829418:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 330 00000100:00100000:3.0:1787833931.829430:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 331 00000100:00100000:3.0:1787833931.829436:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381958784:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833931.829458:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381958784:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833931.829463:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 331 00000100:00100000:3.0:1787833931.829480:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381958016 00000100:00100000:3.0:1787833931.829483:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381958016 00000100:00100000:3.0:1787833931.829508:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 391 00000100:00100000:3.0:1787833931.829514:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381958016:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833931.829537:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381958016:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833931.829543:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 391 00000100:00080000:3.0:1787833931.829577:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787833931.829580:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833931.829583:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833931.829584:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787833932.248542:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787833932.565905:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833933.142332:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406147840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787833933.142407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833933.142478:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406147840 00000100:00100000:2.0:1787833933.142485:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406147840 00000100:00100000:2.0:1787833933.142531:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787833933.142539:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406147840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833933.142571:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833933.142614:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406147840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.142621:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787833933.142662:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406147840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833933.340276:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833933.342714:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381958912 00000100:00100000:2.0:1787833933.342728:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381958912 00000100:00100000:2.0:1787833933.342815:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 153 00000100:00100000:2.0:1787833933.342825:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+14:12193:x1874679381958912:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833933.342843:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833933.342862:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dd19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed4b expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.342923:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.342937:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.342950:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.342963:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.342980:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.342986:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343027:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343035:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343042:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343047:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833933.343051:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343059:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343069:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:2.0:1787833933.343073:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833933.343077:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343083:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1dd20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343096:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343123:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343129:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343134:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833933.343137:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343143:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343151:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df608e13100) 00010000:00010000:2.0:1787833933.343154:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833933.343156:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343162:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1dd27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343322:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dd19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed4b expref: 15 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343334:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:2.0:1787833933.343336:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833933.343339:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1dd19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed4b expref: 15 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.343360:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e000, rc 0) 00000100:00100000:2.0:1787833933.343430:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+14:12193:x1874679381958912:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 606us (3162us total) trans 0 rc 301/301 00000100:00100000:2.0:1787833933.343437:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 153 00000100:00080000:3.0:1787833933.343893:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833933.355376:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833933.364974:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381959168 00000100:00100000:1.0:1787833933.364988:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381959168 00000100:00100000:1.0:1787833933.365079:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 154 00000100:00100000:1.0:1787833933.365090:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+14:12193:x1874679381959168:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:1.0:1787833933.365153:0:9772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833933.365180:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1d66d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb6f expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.365217:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:1.0:1787833933.365222:0:9772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833933.365282:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.365296:0:9772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed3d expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.365304:0:9772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.365376:0:9772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed3d expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.365393:0:9772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed3d expref: 5 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833933.365406:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406147968:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833933.365500:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605387c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833933.368310:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833933.368397:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406147968:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833933.368424:0:9772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833933.368527:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381959296 00000100:00100000:0.0:1787833933.368611:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381959296 00010000:00010000:0.0:1787833933.368665:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed3d expref: 6 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833933.368703:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:0.0:1787833933.368713:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2400:x1874679381959296:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833933.368727:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833933.368733:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed3d expref: 6 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.368745:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed3d expref: 6 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.368803:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dcef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed3d expref: 6 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.368818:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:0.0:1787833933.368823:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.368833:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.368840:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787833933.368860:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787833933.368867:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833933.368892:0:9772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.368899:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833933.368923:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381959296:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 212us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833933.368931:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 80 00010000:00010000:1.0:1787833933.368933:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.368942:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.368950:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.369840:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.369855:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.369864:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833933.369878:0:9772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a864c8af reply state 0000000046718425 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.369889:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.370308:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:1.0:1787833933.370312:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833933.370315:0:9772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787833933.370321:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787833933.370330:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.370338:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.370354:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.370361:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833933.370365:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.370373:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.370384:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df602ff4700) 00010000:00010000:1.0:1787833933.370387:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833933.370390:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.370397:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833933.370416:0:9772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a864c8af reply state 0000000046718425 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.370425:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.370432:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df503f0eb00) 00010000:00010000:1.0:1787833933.370434:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833933.370436:0:9772:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787833933.370546:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+15:12193:x1874679381959168:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 5455us (15177us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787833933.370555:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 154 00000100:00100000:0.0:1787833933.469128:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833933.470056:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381959424 00000100:00100000:1.0:1787833933.470067:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381959424 00000100:00100000:1.0:1787833933.470141:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 155 00000100:00100000:1.0:1787833933.470152:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504571e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+15:12200:x1874679381959424:12345-192.168.203.17@tcp:101:lctl.0 00010000:00010000:1.0:1787833933.470191:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833933.470216:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed52 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.470282:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1dd4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.470297:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1dd4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.470309:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1dd4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833933.470350:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787833933.470354:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833933.470376:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1dd4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.470400:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed52 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.470418:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1dd4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed52 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.470426:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f0e100) 00010000:00010000:1.0:1787833933.470429:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833933.470445:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723200, rc 0) 00000100:00100000:1.0:1787833933.470516:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504571e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+16:12200:x1874679381959424:12345-192.168.203.17@tcp:101:lctl.0 Request processed in 366us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833933.470523:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 155 00000100:00100000:2.0:1787833933.518178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833933.518365:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381959552 00000100:00100000:1.0:1787833933.518374:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381959552 00000100:00100000:1.0:1787833933.518433:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 156 00000100:00100000:1.0:1787833933.518442:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+16:12207:x1874679381959552:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833933.518464:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833933.518483:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed59 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518543:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518555:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518565:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518574:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518580:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518586:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518651:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dd66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518671:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dd66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518679:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dd66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833933.518713:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787833933.518716:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833933.518733:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dd66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518744:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518786:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518792:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518797:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833933.518801:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518808:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518821:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f0e100) 00010000:00010000:1.0:1787833933.518824:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833933.518830:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518847:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dd58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518862:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518868:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518875:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518879:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833933.518882:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518887:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518894:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df503f0eb00) 00010000:00010000:1.0:1787833933.518897:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833933.518899:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518904:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dd5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518927:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dd51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed59 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518939:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dd66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed59 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.518952:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:1.0:1787833933.518955:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787833933.518957:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722600, rc 0) 00000100:00100000:2.0:1787833933.521969:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+17:12207:x1874679381959552:12345-192.168.203.17@tcp:101:bash.0 Request processed in 3516us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.521982:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 156 00000100:00100000:3.0:1787833933.524963:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833933.527560:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381959808 00000100:00100000:1.0:1787833933.527574:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381959808 00000100:00100000:0.0:1787833933.527846:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 157 00000100:00100000:0.0:1787833933.527857:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+17:12207:x1874679381959808:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1787833933.527878:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833933.527899:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dd6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed60 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528008:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528023:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528049:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528268:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528277:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528285:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787833933.528657:0:9772:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787833933.528878:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528889:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528897:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528930:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.528938:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.529268:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.529277:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833933.529291:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.529300:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.529313:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833933.529316:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833933.529322:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.529329:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dd74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833933.529342:0:9772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cab1ba0 reply state 000000003045a735 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.529354:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.529361:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69800) 00010000:00010000:0.0:1787833933.529438:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787833933.529442:0:9772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787833933.529477:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1dd6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed60 expref: 20 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.529491:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed60 expref: 19 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.529498:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69100) 00010000:00010000:0.0:1787833933.529501:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833933.529510:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247c00, rc 0) 00000100:00100000:0.0:1787833933.529632:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+20:12207:x1874679381959808:12345-192.168.203.17@tcp:101:bash.0 Request processed in 1776us (4688us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1787833933.529642:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 157 00000100:00100000:0.0:1787833933.535144:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833933.535377:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381959936 00000100:00100000:3.0:1787833933.535387:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381959936 00000100:00080000:2.0:1787833933.535517:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833933.535539:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:3.0:1787833933.535563:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504572580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381959936:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833933.535580:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833933.535599:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed67 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833933.535625:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787833933.536271:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787833933.536278:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833933.536288:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed67 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.536310:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed67 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.536322:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031800, rc 0) 00000100:00100000:3.0:1787833933.536388:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504572580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381959936:12345-192.168.203.17@tcp:101:bash.0 Request processed in 828us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833933.537542:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:3.0:1787833933.544302:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833933.544569:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381960064 00000100:00100000:2.0:1787833933.544578:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381960064 00000100:00100000:2.0:1787833933.544635:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:2.0:1787833933.544645:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:12207:x1874679381960064:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1787833933.544663:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833933.544683:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed6e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.544715:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed67 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.544725:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833933.544729:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833933.544736:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.544822:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed67 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.544835:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed67 expref: 7 pid: 8431 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833933.544849:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc66d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874679406148096:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833933.544931:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833933.554290:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833933.554465:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc66d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874679406148096:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833933.554501:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.554521:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f600, rc 0) 00000100:00100000:3.0:1787833933.554585:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:12207:x1874679381960064:12345-192.168.203.17@tcp:101:bash.0 Request processed in 9941us (10294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833933.554606:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:0.0:1787833933.555248:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381960192 00000100:00100000:0.0:1787833933.555257:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381960192 00010000:00010000:0.0:1787833933.555294:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed67 expref: 7 pid: 8431 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833933.555548:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 81 00000100:00100000:0.0:1787833933.555559:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381960192:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833933.555573:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833933.555594:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed67 expref: 7 pid: 8431 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.555608:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed67 expref: 7 pid: 8431 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.555629:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb09f73/0x996d2fb20dc1dd90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed67 expref: 7 pid: 8431 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.555644:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833933.556052:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833933.556065:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.556091:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.556142:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833933.556164:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874679406148224:192.168.203.17@tcp:105: 00000100:00100000:0.0:1787833933.556281:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833933.560539:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833933.560625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381960448 00000100:00100000:3.0:1787833933.560633:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381960448 00000100:00100000:3.0:1787833933.560714:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:3.0:1787833933.560725:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+20:12207:x1874679381960448:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:3.0:1787833933.561059:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+21:12207:x1874679381960448:12345-192.168.203.17@tcp:35:bash.0 Request processed in 336us (528us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787833933.561068:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:0.0:1787833933.561685:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874679406148224:192.168.203.17@tcp:105: 00010000:00010000:0.0:1787833933.561706:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833933.561747:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381960192:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 6190us (7465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833933.561770:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 81 00010000:00010000:3.0:1787833933.589996:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833933.647518:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833933.647616:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381960704 00000100:00100000:3.0:1787833933.647626:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381960704 00000100:00100000:3.0:1787833933.647703:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 158 00000100:00100000:3.0:1787833933.647713:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+21:12217:x1874679381960704:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787833933.647746:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833933.647794:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dd9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed75 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833933.647895:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787833933.648000:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dd9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed75 expref: 23 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.648014:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f0e100) 00010000:00010000:3.0:1787833933.648017:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833933.648022:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dd9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed75 expref: 23 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.648055:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031200, rc 0) 00000100:00100000:3.0:1787833933.648125:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+22:12217:x1874679381960704:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 413us (616us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1787833933.648132:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 158 00000100:00100000:2.0:1787833933.654196:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406148352:0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.654273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833933.654459:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406148352 00000100:00100000:0.0:1787833933.654467:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406148352 00000100:00100000:0.0:1787833933.654518:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787833933.654528:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406148352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.654564:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406148864:0@lo:400:kworker.0 00000100:00100000:0.0:1787833933.654582:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406148352:12345-0@lo:400:kworker.0 Request processed in 55us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833933.654590:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787833933.654604:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833933.654641:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406148352:0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.654659:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833933.654664:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406148480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833933.654691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833933.654730:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406148608:0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.654773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833933.654792:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833933.654798:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406148736:0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.654839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833933.654882:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406148864 00000100:00100000:2.0:1787833933.654886:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406148864 00000100:00100000:2.0:1787833933.654911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406148608 00000100:00100000:2.0:1787833933.654914:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406148608 00000100:00100000:2.0:1787833933.654932:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787833933.654937:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406148864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.654986:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406148864:12345-0@lo:400:kworker.0 Request processed in 48us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.654992:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787833933.655004:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787833933.655009:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406148608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.655035:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406148608:12345-0@lo:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.655040:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787833933.655064:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406148608:0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.655083:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406148864:0@lo:400:kworker.0 00000100:00100000:0.0:1787833933.655218:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406148480 00000100:00100000:0.0:1787833933.655222:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406148480 00000100:00100000:0.0:1787833933.655267:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787833933.655273:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406148480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787833933.655302:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833933.655336:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406148480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833933.655342:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787833933.655361:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406148736 00000100:00100000:0.0:1787833933.655364:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406148736 00000100:00100000:0.0:1787833933.655384:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787833933.655390:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620512580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406148736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833933.655421:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620512580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406148736:12345-0@lo:400:kworker.0 Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833933.655427:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787833933.655450:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406148736:0@lo:400:kworker.0 00000100:00080000:2.0:1787833933.655516:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833933.655542:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406148480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833933.657509:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406148992:0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.657572:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833933.657605:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504484f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406149504:0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.657629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833933.657653:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833933.657660:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406149376:0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.657686:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833933.657719:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406149376 00000100:00100000:3.0:1787833933.657726:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406149376 00000100:00100000:3.0:1787833933.657795:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787833933.657804:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406149376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.657853:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406149376:12345-0@lo:400:kworker.0 Request processed in 51us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833933.657860:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787833933.658122:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406149376:0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658148:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406149248:0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833933.658268:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406149760:0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833933.658318:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787833933.658326:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406149120:0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833933.658366:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fc6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406149632:0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787833933.658408:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833933.658423:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406148992 00000100:00100000:3.0:1787833933.658427:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406148992 00000100:00100000:3.0:1787833933.658455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406149504 00000100:00100000:3.0:1787833933.658458:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406149504 00000100:00100000:3.0:1787833933.658472:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406149120 00000100:00100000:3.0:1787833933.658474:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406149120 00000100:00100000:3.0:1787833933.658485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406149632 00000100:00100000:3.0:1787833933.658487:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406149632 00000100:00100000:3.0:1787833933.658499:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787833933.658505:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406148992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658545:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406148992:12345-0@lo:400:kworker.0 Request processed in 40us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833933.658551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787833933.658564:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787833933.658570:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406149504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658597:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406149504:12345-0@lo:400:kworker.0 Request processed in 28us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833933.658602:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787833933.658613:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787833933.658619:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406149120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658651:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406149120:12345-0@lo:400:kworker.0 Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833933.658667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787833933.658680:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787833933.658686:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406149632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406149632:12345-0@lo:400:kworker.0 Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833933.658721:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787833933.658777:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406148992:0@lo:400:kworker.0 00000100:00100000:3.0:1787833933.658790:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504484f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406149504:0@lo:400:kworker.0 00010000:00080000:3.0:1787833933.658818:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fba7840 x1874679406149120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833933.658828:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406149120:0@lo:400:kworker.0 00010000:00080000:3.0:1787833933.658838:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fc6d2c0 x1874679406149632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833933.658846:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406149632:0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.658984:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406149248 00000100:00100000:2.0:1787833933.658989:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406149248 00000100:00100000:2.0:1787833933.659018:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406149760 00000100:00100000:2.0:1787833933.659021:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406149760 00000100:00100000:2.0:1787833933.659038:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787833933.659044:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406149248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.659082:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406149248:12345-0@lo:400:kworker.0 Request processed in 38us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.659093:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787833933.659117:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787833933.659122:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406149760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.659275:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406149760:12345-0@lo:400:kworker.0 Request processed in 30us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.659282:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787833933.659314:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406149248:0@lo:400:kworker.0 00000100:00100000:2.0:1787833933.659323:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fc6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406149760:0@lo:400:kworker.0 00000100:00080000:3.0:1787833933.660162:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787833933.660169:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833933.660171:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833933.660174:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833933.660246:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833933.660466:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381960960 00000100:00100000:2.0:1787833933.660472:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381960960 00000100:00100000:2.0:1787833933.660517:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:2.0:1787833933.660526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+22:12217:x1874679381960960:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1787833933.660730:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+23:12217:x1874679381960960:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 205us (485us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787833933.660738:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:2.0:1787833933.660784:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406149888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833933.660823:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833933.660875:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406149888 00000100:00100000:2.0:1787833933.660879:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406149888 00000100:00100000:2.0:1787833933.660907:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787833933.660914:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406149888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833933.660929:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833933.660978:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406149888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.660999:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787833933.661043:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406149888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833933.725994:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833933.728737:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381961088 00000100:00100000:3.0:1787833933.728765:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381961088 00000100:00100000:2.0:1787833933.734791:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00100000:2.0:1787833933.734805:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+23:12223:x1874679381961088:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833933.734828:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833933.734847:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ddac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed7c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.735072:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ddb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.735087:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ddb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.735109:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ddb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833933.735152:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787833933.735156:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833933.735174:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ddb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.735201:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ddac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed7c expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.735219:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ddb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed7c expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.735247:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:2.0:1787833933.735251:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833933.735254:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e800, rc 0) 00000100:00100000:2.0:1787833933.735380:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+24:12223:x1874679381961088:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 577us (9394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.735388:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00100000:2.0:1787833933.745695:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833933.745832:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381961344 00000100:00100000:3.0:1787833933.745841:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381961344 00000100:00100000:3.0:1787833933.745899:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 160 00000100:00100000:3.0:1787833933.745909:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620511680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+24:12223:x1874679381961344:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787833933.745941:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833933.745961:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1ddba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed83 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.746248:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1ddc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.746264:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1ddc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.746280:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1ddc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833933.746290:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787833933.746540:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1ddba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed83 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.746851:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1ddc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed83 expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.746862:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69100) 00010000:00010000:3.0:1787833933.746865:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833933.746868:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031600, rc 0) 00000100:00100000:3.0:1787833933.746939:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620511680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+26:12223:x1874679381961344:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1031us (1252us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1787833933.746946:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 160 00000100:00100000:3.0:1787833933.755637:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833933.756417:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381961600 00000100:00100000:0.0:1787833933.756426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381961600 00000100:00100000:0.0:1787833933.756556:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 161 00000100:00100000:0.0:1787833933.756568:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+26:12223:x1874679381961600:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833933.756593:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833933.756613:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1ddcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed8a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833933.756705:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:0.0:1787833933.756721:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1ddd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.756736:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1ddd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.756746:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1ddd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833933.756790:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787833933.756886:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1ddcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed8a expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.756903:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1ddd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed8a expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.756910:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69100) 00010000:00010000:0.0:1787833933.756913:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787833933.756917:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246200, rc 0) 00000100:00100000:1.0:1787833933.756948:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381961728 00000100:00100000:1.0:1787833933.756955:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381961728 00000100:00100000:0.0:1787833933.756987:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+29:12223:x1874679381961600:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 420us (1358us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1787833933.756994:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:0.0:1787833933.757000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 161 00000100:00100000:1.0:1787833933.757005:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+29:2400:x1874679381961728:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833933.757015:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833933.757030:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1ddc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed83 expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.757043:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69100) 00010000:00010000:1.0:1787833933.757047:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833933.757066:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+27:2400:x1874679381961728:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 65us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833933.757072:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1787833933.767048:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833933.767139:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381961856 00000100:00100000:2.0:1787833933.767149:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381961856 00000100:00100000:2.0:1787833933.767207:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:2.0:1787833933.767218:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2401:x1874679381961856:12345-192.168.203.17@tcp:1:lfs.0 00010000:00010000:2.0:1787833933.767262:0:8583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.767282:0:8583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.767292:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833933.767297:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833933.767301:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.767346:0:8583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.767371:0:8583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 6 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833933.767386:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6205130c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8583:1874679406150016:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833933.767494:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833933.779868:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833933.780080:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6205130c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8583:1874679406150016:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833933.780115:0:8583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833933.780197:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381961984 00000100:00100000:0.0:1787833933.780205:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381961984 00002000:00100000:0.0:1787833933.780249:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8df63fba7840 x1874679381961984/t0(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:739/0 lens 504/0 e 0 to 0 dl 1787833944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833933.780273:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df63fba7840 with x1874679381961984 ext(0->12) 00010000:00010000:0.0:1787833933.780281:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 7 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.780295:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 7 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833933.780303:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df63fba7840 00000100:00100000:0.0:1787833933.780337:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:0.0:1787833933.780357:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381961984:12345-192.168.203.17@tcp:4:lfs.0 00000100:00100000:0.0:1787833933.781618:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381961984:12345-192.168.203.17@tcp:4:lfs.0 Request processed in 1256us (1751us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787833933.781630:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00002000:00100000:0.0:1787833933.781859:0:8436:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8df63fba7840 x1874679381961984/t4294967306(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:739/0 lens 504/448 e 0 to 0 dl 1787833944 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833933.781869:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df63fba7840 with x1874679381961984 ext(0->12) 00010000:00010000:0.0:1787833933.781878:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.781895:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833933.781903:0:8436:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df63fba7840 00000100:00100000:0.0:1787833933.785746:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833933.785911:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381962112 00000100:00100000:1.0:1787833933.785921:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381962112 00010000:00010000:1.0:1787833933.785972:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833933.786011:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:1.0:1787833933.786023:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381962112:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833933.786051:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787833933.786068:0:6499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787833933.786071:0:6499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787833933 00002000:00010000:1.0:1787833933.786074:0:6499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787833934 00002000:00010000:1.0:1787833933.786086:0:6499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787833933 00002000:00010000:1.0:1787833933.786089:0:6499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787833933.786104:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.786119:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.786144:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dee45b7/0x996d2fb20dc1dd97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed6e expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.786160:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833933.786165:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833933.786170:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.786181:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.786216:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833933.786276:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381962112:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 255us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833933.786284:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 82 00010000:00010000:2.0:1787833933.786410:0:8583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.786420:0:8583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.786440:0:8583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.786448:0:8583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.786455:0:8583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.786474:0:8583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833933.786478:0:8583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.786488:0:8583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.786500:0:8583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.786507:0:8583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e199eee4/0x996d2fb20dc1dde4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833933.786555:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2401:x1874679381961856:12345-192.168.203.17@tcp:1:lfs.0 Request processed in 19339us (19516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.786563:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:3.0:1787833933.790851:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833933.791383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381962368 00000100:00100000:2.0:1787833933.791393:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381962368 00000100:00100000:2.0:1787833933.791479:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:2.0:1787833933.791489:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df610440c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12223:x1874679381962368:12345-192.168.203.17@tcp:35:lfs.0 00000004:00010000:2.0:1787833933.791553:0:6517:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1ddd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed8a expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833933.791815:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1787833933.791847:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787833933.792334:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1787833933.792375:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.792392:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed60 expref: 31 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.792401:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.792435:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed60 expref: 31 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.792451:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed60 expref: 31 pid: 9772 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833933.792465:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6205130c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1874679406150144:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833933.796422:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833933.801087:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6205130c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1874679406150144:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833933.801126:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833933.804137:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833933.804652:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381962496 00000100:00100000:1.0:1787833933.804661:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381962496 00010000:00010000:1.0:1787833933.804704:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed60 expref: 32 pid: 9772 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833933.804734:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:1.0:1787833933.804742:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+32:2401:x1874679381962496:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833933.804790:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833933.804797:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed60 expref: 32 pid: 9772 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.804810:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed60 expref: 32 pid: 9772 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.804829:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dd82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed60 expref: 32 pid: 9772 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.804843:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69100) 00010000:00010000:1.0:1787833933.804848:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.804856:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.804864:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833933.804889:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833933.804935:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+31:2401:x1874679381962496:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 193us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833933.804954:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 83 00010000:00010000:3.0:1787833933.805040:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.805050:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833933.805180:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1787833933.805297:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1787833933.806611:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1874679406150272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787833933.806663:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833933.806691:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5024a8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833933.806927:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406150272 00000100:00100000:2.0:1787833933.806934:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406150272 00000100:00100000:2.0:1787833933.806982:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787833933.806991:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6059e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1874679406150272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787833933.807089:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6059e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1874679406150272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.807107:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787833933.808458:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1874679406150272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787833933.808606:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1787833933.808683:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6059eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1874679406150400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787833933.808737:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833933.808828:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5024a8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787833933.808918:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406150400 00000100:00100000:0.0:1787833933.808924:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406150400 00000100:00100000:0.0:1787833933.809240:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787833933.809250:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1874679406150400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787833933.809606:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6517:x1874679406150400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 357us (868us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787833933.809614:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787833933.809744:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6059eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1874679406150400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787833933.809864:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1787833933.809900:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.809911:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.809919:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.809941:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833933.810073:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.810082:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.810107:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69100) 00010000:00010000:3.0:1787833933.810110:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787833933.810115:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.810123:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ddeb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833933.810222:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787833933.810286:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787833933.810297:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409723545835ns, next at 410723543830ns, rc = 0 00000001:00080000:3.0:1787833933.810304:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1787833933.810444:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69100) 00010000:00010000:3.0:1787833933.810447:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787833933.810454:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1ddd6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed8a expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833933.810600:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df610440c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+34:12223:x1874679381962368:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 19112us (19756us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787833933.810609:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000020:00080000:3.0:1787833933.810613:0:6517:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787833933.815261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833933.815412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381962624 00000100:00100000:2.0:1787833933.815422:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381962624 00000100:00100000:2.0:1787833933.815486:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 162 00000100:00100000:2.0:1787833933.815497:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+34:12223:x1874679381962624:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833933.815519:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833933.815541:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ddf2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed91 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.815598:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ddf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed91 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.815613:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ddf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed91 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.815630:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833933.815633:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833933.815636:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e600, rc 0) 00000100:00100000:2.0:1787833933.815706:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+35:12223:x1874679381962624:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 211us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.815713:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 162 00000100:00100000:1.0:1787833933.819283:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833933.819375:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381962880 00000100:00100000:0.0:1787833933.819384:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381962880 00000100:00100000:0.0:1787833933.819442:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:0.0:1787833933.819452:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+35:12223:x1874679381962880:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1787833933.819703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+36:12223:x1874679381962880:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 251us (428us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787833933.819711:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:1.0:1787833933.887364:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833933.887517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381963136 00000100:00100000:3.0:1787833933.887527:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381963136 00000100:00100000:3.0:1787833933.887590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 163 00000100:00100000:3.0:1787833933.887601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+36:12233:x1874679381963136:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787833933.887625:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833933.887644:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1ddf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed98 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833933.887934:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787833933.888040:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1ddf9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed98 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.888055:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f0e100) 00010000:00010000:3.0:1787833933.888058:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833933.888062:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1ddf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed98 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833933.888076:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031200, rc 0) 00000100:00100000:3.0:1787833933.888163:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+37:12233:x1874679381963136:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 563us (807us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787833933.888170:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 163 00000100:00100000:1.0:1787833933.892297:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833933.892510:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381963264 00000100:00100000:0.0:1787833933.892520:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381963264 00000100:00100000:0.0:1787833933.892585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 164 00000100:00100000:0.0:1787833933.892596:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+37:12233:x1874679381963264:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:0.0:1787833933.892915:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.892939:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893021:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893035:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893043:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893050:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893130:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893139:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893164:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833933.893216:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893230:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893236:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893243:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893249:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833933.893253:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893261:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893273:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833933.893276:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833933.893281:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893287:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893299:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893508:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893517:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893522:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833933.893525:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893532:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893541:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69800) 00010000:00010000:0.0:1787833933.893544:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833933.893547:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893553:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893564:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893570:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893576:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893580:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833933.893590:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893596:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893604:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833933.893607:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833933.893610:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.893617:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833933.894053:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+37:12233:x1874679381963264:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 1455us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833933.894062:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 164 00000100:00100000:1.0:1787833933.899402:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833933.899746:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381963520 00000100:00100000:0.0:1787833933.899878:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381963520 00000100:00100000:3.0:1787833933.899973:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:3.0:1787833933.899985:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+37:12233:x1874679381963520:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787833933.900247:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+38:12233:x1874679381963520:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 265us (853us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787833933.900253:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:1.0:1787833933.939600:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833933.939700:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381963776 00000100:00100000:0.0:1787833933.939709:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381963776 00000100:00100000:0.0:1787833933.939795:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 165 00000100:00100000:0.0:1787833933.939805:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+38:12236:x1874679381963776:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833933.939827:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833933.939845:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ed9f expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.939913:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.939930:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.939956:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.939968:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.939975:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.939981:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940553:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940565:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940573:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833933.940583:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787833933.940656:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940663:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940670:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940676:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833933.940687:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940695:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940707:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833933.940710:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833933.940715:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940722:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940736:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940742:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940902:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940909:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833933.940913:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940919:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940927:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69800) 00010000:00010000:0.0:1787833933.940929:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833933.940939:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940945:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.940985:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed9f expref: 41 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.941000:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed9f expref: 40 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833933.941006:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833933.941009:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833933.941011:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247e00, rc 0) 00000100:00100000:0.0:1787833933.941086:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+40:12236:x1874679381963776:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1282us (1493us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787833933.941102:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 165 00000100:00100000:1.0:1787833933.943567:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833933.943842:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381963904 00000100:00100000:2.0:1787833933.943852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381963904 00000100:00100000:2.0:1787833933.943938:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 166 00000100:00100000:2.0:1787833933.943949:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+40:12236:x1874679381963904:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:2.0:1787833933.944012:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.944044:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.944072:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.944117:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.944125:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.944132:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.944138:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833933.944142:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.944150:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.944161:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833933.944164:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833933.944168:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833933.944174:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833933.944253:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+40:12236:x1874679381963904:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 306us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.944271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 166 00000100:00100000:1.0:1787833933.947573:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833933.948035:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381964160 00000100:00100000:0.0:1787833933.948044:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381964160 00000100:00100000:0.0:1787833933.948703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:0.0:1787833933.948716:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+40:12236:x1874679381964160:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1787833933.948965:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+41:12236:x1874679381964160:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 251us (1399us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787833933.948973:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:1.0:1787833934.219040:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.219305:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381964416 00000100:00100000:0.0:1787833934.219315:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381964416 00000100:00100000:0.0:1787833934.219421:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 167 00000100:00100000:0.0:1787833934.219431:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504614b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+41:12267:x1874679381964416:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:0.0:1787833934.219472:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833934.219495:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eda6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.219600:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.219614:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.219627:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833934.219637:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787833934.219736:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eda6 expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.219784:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eda6 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.219792:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833934.219795:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833934.219799:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246200, rc 0) 00000100:00100000:0.0:1787833934.220005:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504614b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+43:12267:x1874679381964416:12345-192.168.203.17@tcp:101:cat.0 Request processed in 432us (831us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787833934.220014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 167 00000100:00100000:1.0:1787833934.224959:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833934.225147:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381964544 00000100:00100000:2.0:1787833934.225169:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381964544 00000100:00100000:2.0:1787833934.225235:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:2.0:1787833934.225244:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e164050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+43:2398:x1874679381964544:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833934.225261:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833934.225286:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1de4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eda6 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.225305:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833934.225310:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833934.225363:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e164050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+42:2398:x1874679381964544:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 120us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833934.225371:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:1.0:1787833934.227353:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833934.227438:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381964800 00000100:00100000:3.0:1787833934.227447:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381964800 00000100:00100000:3.0:1787833934.227497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:3.0:1787833934.227507:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504615680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+42:12267:x1874679381964800:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:3.0:1787833934.227777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504615680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+43:12267:x1874679381964800:12345-192.168.203.17@tcp:35:cat.0 Request processed in 242us (402us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1787833934.227787:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:1.0:1787833934.281861:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.282140:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381965056 00000100:00100000:0.0:1787833934.282150:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381965056 00000100:00100000:0.0:1787833934.282211:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 168 00000100:00100000:0.0:1787833934.282235:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504616d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+43:12273:x1874679381965056:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:0.0:1787833934.282258:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833934.282261:0:9772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787833934.282285:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ddb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed7c expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.282305:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833934.282310:0:9772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833934.282322:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de5b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edad expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.282417:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.282429:0:9772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed9f expref: 43 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.282438:0:9772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.282468:0:9772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed9f expref: 43 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.282481:0:9772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed9f expref: 43 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833934.282494:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504573480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406150528:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833934.282590:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2480 going to sleep for 11 seconds 00000100:00100000:1.0:1787833934.286074:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.286268:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504573480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406150528:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833934.286296:0:9772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833934.289035:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381965184 00000100:00100000:2.0:1787833934.289050:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381965184 00010000:00010000:2.0:1787833934.289211:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed9f expref: 44 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833934.289282:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:2.0:1787833934.289293:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504742580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+44:2400:x1874679381965184:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833934.289307:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833934.289314:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed9f expref: 44 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.289327:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed9f expref: 44 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.289351:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1de31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed9f expref: 44 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.289384:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833934.289388:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.289397:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.289405:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.289437:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833934.289505:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504742580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+43:2400:x1874679381965184:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 213us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833934.289512:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 84 00010000:00010000:3.0:1787833934.289564:0:9772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.289571:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833934.289587:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787833934.289717:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1de5b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edad expref: 44 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.289732:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edad expref: 43 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.289738:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:3.0:1787833934.289741:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787833934.289743:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247c00, rc 0) 00000100:00100000:3.0:1787833934.289782:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504616d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+43:12273:x1874679381965056:12345-192.168.203.17@tcp:101:dd.0 Request processed in 7550us (7931us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787833934.289789:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 168 00000100:00100000:1.0:1787833934.293385:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833934.293595:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381965312 00000100:00100000:2.0:1787833934.293604:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381965312 00000100:00100000:2.0:1787833934.293671:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 169 00000100:00100000:2.0:1787833934.293681:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504741680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+43:12273:x1874679381965312:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:2.0:1787833934.293703:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833934.293722:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edb4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.293798:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.293813:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.293824:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.293960:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1de70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edb4 expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.293980:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edb4 expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.293988:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833934.293991:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787833934.293994:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f600, rc 0) 00000100:00100000:2.0:1787833934.294060:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504741680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+44:12273:x1874679381965312:12345-192.168.203.17@tcp:101:dd.0 Request processed in 373us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833934.294068:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 169 00000100:00100000:1.0:1787833934.297985:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.298082:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381965568 00000100:00100000:0.0:1787833934.298091:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381965568 00000100:00100000:0.0:1787833934.298155:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 170 00000100:00100000:0.0:1787833934.298164:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504743c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+44:12273:x1874679381965568:12345-192.168.203.17@tcp:36:dd.0 00010000:00010000:0.0:1787833934.298356:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.298371:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.298382:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833934.298420:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1787833934.298440:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bab34c61 reply state 00000000cd3f039e transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.299373:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.299390:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833934.299393:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787833934.299396:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833934.299503:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504743c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+47:12273:x1874679381965568:12345-192.168.203.17@tcp:36:dd.0 Request processed in 1338us (1524us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1787833934.299512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 170 00000020:00080000:0.0:1787833934.299517:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787833934.534547:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833934.534638:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381965696 00000100:00100000:3.0:1787833934.534647:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381965696 00000100:00100000:3.0:1787833934.534725:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 171 00000100:00100000:3.0:1787833934.534736:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+47:12287:x1874679381965696:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:3.0:1787833934.534797:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833934.534818:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1de85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edbb expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.534893:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.534907:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.534918:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.534929:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.534936:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.534942:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.535011:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.535022:0:9772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edad expref: 48 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.535030:0:9772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.535065:0:9772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edad expref: 48 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.535077:0:9772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edad expref: 48 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833934.535090:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df61189e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406150656:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833934.535188:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5024a8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833934.543138:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833934.543298:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df61189e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406150656:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833934.543322:0:9772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833934.543396:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381965952 00000100:00100000:2.0:1787833934.543403:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381965952 00000100:00100000:2.0:1787833934.543462:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:2.0:1787833934.543472:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+49:6173:x1874679381965952:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787833934.543788:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+50:6173:x1874679381965952:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 281us (624us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787833934.543796:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:1.0:1787833934.546143:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833934.546329:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381966080 00000100:00100000:2.0:1787833934.546338:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381966080 00010000:00010000:2.0:1787833934.546376:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edad expref: 50 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833934.546418:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:2.0:1787833934.546427:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504740780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+50:2401:x1874679381966080:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833934.546455:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833934.546462:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edad expref: 50 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.546476:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edad expref: 50 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.546496:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1de62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edad expref: 50 pid: 9772 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.546512:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833934.546517:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.546527:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.546547:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.546620:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833934.546953:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504740780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+49:2401:x1874679381966080:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 525us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833934.546961:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 85 00010000:00010000:3.0:1787833934.548808:0:9772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.548823:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833934.548880:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787833934.548886:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787833934.548922:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.548938:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.548949:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549045:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549053:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549060:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833934.549065:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549074:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549158:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:3.0:1787833934.549162:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833934.549167:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549174:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1de8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549620:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549633:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549641:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549647:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833934.549658:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549665:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549674:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69800) 00010000:00010000:3.0:1787833934.549676:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833934.549680:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549686:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1de93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549724:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1de85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edbb expref: 49 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549739:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edbb expref: 48 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.549746:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:3.0:1787833934.549776:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833934.549779:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031a00, rc 0) 00000100:00100000:3.0:1787833934.549848:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+48:12287:x1874679381965696:12345-192.168.203.17@tcp:101:stat.0 Request processed in 15114us (15309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833934.549857:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 171 00010000:00010000:3.0:1787833934.614039:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833934.647178:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.647330:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381966336 00000100:00100000:0.0:1787833934.647339:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381966336 00000100:00100000:0.0:1787833934.647398:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 172 00000100:00100000:0.0:1787833934.647407:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+48:12293:x1874679381966336:12345-192.168.203.17@tcp:36:truncate.0 00010000:00010000:0.0:1787833934.647460:0:13407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833934.647488:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1de9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edbb expref: 48 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.647507:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833934.647512:0:13407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833934.647670:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.647683:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.647693:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833934.647732:0:13407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787833934.647809:0:13407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bd0fc39 reply state 00000000cb15f76f transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.647821:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.647826:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833934.647829:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787833934.647831:0:13407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833934.647922:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+50:12293:x1874679381966336:12345-192.168.203.17@tcp:36:truncate.0 Request processed in 516us (754us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787833934.647944:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 172 00000020:00080000:0.0:1787833934.647949:0:13407:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787833934.678542:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833934.678567:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406150784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787833934.678637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833934.678860:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406150784 00000100:00100000:0.0:1787833934.678868:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406150784 00000100:00100000:0.0:1787833934.678920:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787833934.678930:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6205130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406150784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833934.678971:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787833934.679033:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6205130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406150784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833934.679041:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787833934.679313:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406150784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833934.769449:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.769549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381966464 00000100:00100000:0.0:1787833934.769558:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381966464 00000100:00100000:0.0:1787833934.769617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 173 00000100:00100000:0.0:1787833934.769627:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+50:12307:x1874679381966464:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:0.0:1787833934.769649:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833934.770016:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dea8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edc2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770157:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770172:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770182:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770192:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770212:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770218:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770294:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770304:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770312:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833934.770351:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787833934.770356:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833934.770377:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770389:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770397:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770403:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770410:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770426:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833934.770430:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770438:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770451:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833934.770455:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833934.770459:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770466:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1deaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770478:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770484:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770491:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770496:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833934.770499:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770505:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770523:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69800) 00010000:00010000:0.0:1787833934.770526:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833934.770530:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770536:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1deb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770561:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1dea8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc2 expref: 52 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770574:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc2 expref: 51 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.770582:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833934.770584:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833934.770587:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676800, rc 0) 00000100:00100000:0.0:1787833934.771070:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+51:12307:x1874679381966464:12345-192.168.203.17@tcp:101:stat.0 Request processed in 1443us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833934.771087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 173 00000100:00100000:1.0:1787833934.818852:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833934.818966:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381966720 00000100:00100000:3.0:1787833934.818976:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381966720 00000100:00100000:3.0:1787833934.819033:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 174 00000100:00100000:3.0:1787833934.819066:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+51:12317:x1874679381966720:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787833934.819086:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833934.819114:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dec4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edc9 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833934.819209:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787833934.819425:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dec4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc9 expref: 53 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.819439:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f0e100) 00010000:00010000:3.0:1787833934.819442:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833934.819447:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1dec4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc9 expref: 53 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.819462:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031200, rc 0) 00000100:00100000:3.0:1787833934.819532:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+52:12317:x1874679381966720:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 477us (689us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1787833934.819539:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 174 00000100:00100000:1.0:1787833934.821829:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833934.821986:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381966976 00000100:00100000:2.0:1787833934.821996:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381966976 00000100:00100000:2.0:1787833934.822255:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:2.0:1787833934.822266:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df610443c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+52:12317:x1874679381966976:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1787833934.822479:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df610443c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+53:12317:x1874679381966976:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 215us (655us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1787833934.822486:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:0.0:1787833934.886358:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833934.886454:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381967232 00000100:00100000:2.0:1787833934.886463:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381967232 00000100:00100000:2.0:1787833934.886530:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 175 00000100:00100000:2.0:1787833934.886540:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+53:12323:x1874679381967232:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1787833934.886563:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833934.886581:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ded2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edd0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.886690:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.886705:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc2 expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.886713:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.886743:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc2 expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.886784:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc2 expref: 54 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833934.886816:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6205103c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406150912:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833934.886918:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833934.892119:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.892256:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381967360 00000100:00100000:0.0:1787833934.892265:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381967360 00010000:00010000:0.0:1787833934.892307:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc2 expref: 55 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833934.892354:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:0.0:1787833934.892364:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504743840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+55:2400:x1874679381967360:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833934.892397:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833934.892405:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc2 expref: 55 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.892419:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc2 expref: 55 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.892442:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833934.892447:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.892456:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.892464:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.892487:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833934.892549:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504743840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+55:2400:x1874679381967360:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 186us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833934.892557:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 86 00010000:00010000:2.0:1787833934.895166:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1debd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edc2 expref: 54 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833934.895192:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6205103c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406150912:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833934.895217:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.895226:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.895232:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833934.895251:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787833934.895376:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ded2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd0 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.895392:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd0 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.895400:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833934.895404:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787833934.895407:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e800, rc 0) 00000100:00100000:2.0:1787833934.895472:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+54:12323:x1874679381967232:12345-192.168.203.17@tcp:101:bash.0 Request processed in 8933us (9122us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787833934.895493:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 175 00000100:00100000:1.0:1787833934.899462:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.899561:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381967616 00000100:00100000:0.0:1787833934.899571:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381967616 00000100:00100000:0.0:1787833934.899680:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 176 00000100:00100000:0.0:1787833934.899691:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504741e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+54:12323:x1874679381967616:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:0.0:1787833934.899960:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.899979:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.900004:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833934.900048:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1787833934.900462:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fcb011d reply state 0000000080a6759b transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.900478:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.900486:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833934.900488:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787833934.900492:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833934.900600:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504741e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+57:12323:x1874679381967616:12345-192.168.203.17@tcp:36:bash.0 Request processed in 908us (1146us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1787833934.900608:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 176 00000020:00080000:0.0:1787833934.900613:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787833934.906253:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833934.906524:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381967744 00000100:00100000:3.0:1787833934.906533:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381967744 00000100:00100000:3.0:1787833934.906585:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 177 00000100:00100000:3.0:1787833934.906604:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504740b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+57:12323:x1874679381967744:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833934.906626:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833934.906645:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1deee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edd7 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.906788:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.907049:0:9772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd0 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.907059:0:9772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.907215:0:9772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd0 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833934.907230:0:9772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd0 expref: 58 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833934.907243:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df61189e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406151040:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833934.907451:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5024a8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833934.913546:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833934.913641:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381967872 00000100:00100000:1.0:1787833934.913656:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381967872 00010000:00010000:1.0:1787833934.913702:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd0 expref: 59 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833934.913865:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00100000:1.0:1787833934.913879:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+59:2400:x1874679381967872:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833934.913894:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833934.913902:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd0 expref: 59 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833934.913916:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd0 expref: 59 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833934.913948:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:1.0:1787833934.913954:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833934.913964:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833934.913972:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833934.913990:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833934.914047:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503f40f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+59:2400:x1874679381967872:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 173us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833934.914056:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 87 00010000:00010000:0.0:1787833934.914445:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ded9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd0 expref: 58 pid: 6513 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833934.914464:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df61189e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406151040:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833934.914487:0:9772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.914496:0:9772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.914502:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833934.914571:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787833934.914575:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833934.914596:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.914630:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1deee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd7 expref: 58 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.914646:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd7 expref: 57 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.914661:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833934.914664:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833934.914666:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031c00, rc 0) 00000100:00100000:0.0:1787833934.914710:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504740b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+57:12323:x1874679381967744:12345-192.168.203.17@tcp:101:bash.0 Request processed in 8116us (8466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833934.914717:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 177 00000100:00100000:3.0:1787833934.918207:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.918367:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381968128 00000100:00100000:0.0:1787833934.918377:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381968128 00000100:00100000:0.0:1787833934.918473:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:0.0:1787833934.918484:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+57:12323:x1874679381968128:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:0.0:1787833934.919479:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+58:12323:x1874679381968128:12345-192.168.203.17@tcp:35:bash.0 Request processed in 991us (1275us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787833934.919491:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:3.0:1787833934.986157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833934.986436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381968384 00000100:00100000:2.0:1787833934.986446:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381968384 00000100:00100000:2.0:1787833934.986511:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 178 00000100:00100000:2.0:1787833934.986521:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+58:12333:x1874679381968384:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833934.986543:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833934.986561:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1defc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edde expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833934.986653:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787833934.986790:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1defc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edde expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.986812:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f0e100) 00010000:00010000:2.0:1787833934.986815:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833934.986820:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1defc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edde expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833934.986835:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e000, rc 0) 00000100:00100000:2.0:1787833934.986892:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+59:12333:x1874679381968384:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 373us (745us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1787833934.986900:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 178 00000100:00100000:3.0:1787833934.989859:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833934.989925:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381968512 00000100:00100000:0.0:1787833934.989934:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381968512 00000100:00100000:0.0:1787833934.989997:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 179 00000100:00100000:0.0:1787833934.990006:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+59:12333:x1874679381968512:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:0.0:1787833934.990083:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990108:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990119:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990131:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990138:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990144:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990209:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990218:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990225:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833934.990267:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990280:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990293:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990299:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990304:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833934.990308:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990315:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990326:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833934.990329:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833934.990334:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990340:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990354:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990360:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990366:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990372:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833934.990382:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990388:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990396:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69800) 00010000:00010000:0.0:1787833934.990399:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833934.990401:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990407:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990417:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990422:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990428:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990433:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833934.990436:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990442:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990449:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833934.990450:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833934.990459:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833934.990464:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833934.990537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+59:12333:x1874679381968512:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 531us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833934.990544:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 179 00000100:00100000:1.0:1787833934.993018:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833934.993463:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381968768 00000100:00100000:3.0:1787833934.993473:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381968768 00000100:00100000:3.0:1787833934.993525:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:3.0:1787833934.993535:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+59:12333:x1874679381968768:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787833934.993743:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+60:12333:x1874679381968768:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 210us (733us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787833934.993777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:3.0:1787833935.039849:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833935.039980:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381969024 00000100:00100000:0.0:1787833935.039990:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381969024 00000100:00100000:0.0:1787833935.040065:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 180 00000100:00100000:0.0:1787833935.040077:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+60:12336:x1874679381969024:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833935.040110:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833935.040129:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ede5 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040220:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040234:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040246:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040256:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040263:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040280:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040396:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1df34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040404:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1df34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040412:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1df34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833935.040420:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787833935.040503:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040511:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040517:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040523:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833935.040527:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040535:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040546:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833935.040549:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833935.040560:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040567:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1df26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040581:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040588:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040594:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040599:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833935.040602:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040607:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040616:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69800) 00010000:00010000:0.0:1787833935.040618:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833935.040621:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040627:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040664:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ede5 expref: 63 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040690:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1df34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ede5 expref: 62 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.040697:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833935.040700:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833935.040702:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677200, rc 0) 00000100:00100000:0.0:1787833935.040805:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+62:12336:x1874679381969024:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 731us (965us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787833935.040812:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 180 00000100:00080000:3.0:1787833935.041052:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833935.045966:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833935.046010:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833935.046110:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381969280 00000100:00100000:2.0:1787833935.046119:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381969280 00000100:00100000:2.0:1787833935.046181:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 181 00000100:00100000:2.0:1787833935.046192:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+62:12336:x1874679381969280:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:2.0:1787833935.046282:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.046299:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.046311:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.046357:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.046365:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.046372:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.046379:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833935.046384:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.046392:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.046403:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833935.046406:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833935.046411:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.046418:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833935.046513:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+62:12336:x1874679381969280:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 323us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.046521:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 181 00000100:00100000:0.0:1787833935.047287:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381969152 00000100:00100000:0.0:1787833935.047295:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381969152 00000100:00100000:0.0:1787833935.047417:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:0.0:1787833935.047426:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+62:2401:x1874679381969152:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833935.047440:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833935.047459:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1df34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ede5 expref: 62 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.047538:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833935.047544:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833935.047590:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+61:2401:x1874679381969152:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 166us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833935.047598:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:1.0:1787833935.048777:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833935.048919:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381969536 00000100:00100000:3.0:1787833935.048927:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381969536 00000100:00100000:3.0:1787833935.048975:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:3.0:1787833935.048985:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+61:12336:x1874679381969536:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787833935.049242:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+62:12336:x1874679381969536:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 257us (491us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787833935.049250:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:1.0:1787833935.202353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833935.202558:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381969792 00000100:00100000:2.0:1787833935.202568:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381969792 00000100:00100000:2.0:1787833935.202630:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 182 00000100:00100000:2.0:1787833935.202639:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+62:12354:x1874679381969792:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:2.0:1787833935.202671:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833935.202691:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.202819:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df50 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.202835:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.202848:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833935.202860:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787833935.202962:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edec expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.202981:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edec expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.202990:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833935.203006:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787833935.203010:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e800, rc 0) 00000100:00100000:2.0:1787833935.203084:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12354:x1874679381969792:12345-192.168.203.17@tcp:101:cat.0 Request processed in 446us (739us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1787833935.203102:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 182 00000100:00100000:2.0:1787833935.231813:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833935.232380:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381969920 00000100:00100000:0.0:1787833935.232390:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381969920 00000100:00100000:0.0:1787833935.232450:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 183 00000100:00100000:0.0:1787833935.232467:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6205103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12355:x1874679381969920:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833935.232496:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833935.232513:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1df5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edf3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.232705:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.232720:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.232745:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833935.232811:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787833935.232815:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833935.232833:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.232859:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1df5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edf3 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.232877:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edf3 expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.232885:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833935.232888:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833935.232891:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677a00, rc 0) 00000100:00100000:0.0:1787833935.232956:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6205103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12355:x1874679381969920:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 490us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833935.232969:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 183 00000100:00100000:1.0:1787833935.242926:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833935.243193:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381970304 00000100:00100000:3.0:1787833935.243203:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381970304 00000100:00100000:3.0:1787833935.243294:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:3.0:1787833935.243305:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12355:x1874679381970304:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787833935.243571:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12355:x1874679381970304:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 267us (654us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787833935.243579:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:1.0:1787833935.250171:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833935.250636:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381970432 00000100:00100000:2.0:1787833935.250645:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381970432 00000100:00100000:2.0:1787833935.250929:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:2.0:1787833935.250948:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12355:x1874679381970432:12345-192.168.203.17@tcp:103:lfs.0 00010000:00010000:2.0:1787833935.250964:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787833935.250989:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1def5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edd7 expref: 66 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.251010:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edec expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.251022:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ddf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed91 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.251032:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833935.251037:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833935.251115:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+63:12355:x1874679381970432:12345-192.168.203.17@tcp:103:lfs.0 Request processed in 169us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.251121:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:3.0:1787833935.254377:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833935.254579:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381970560 00000100:00100000:0.0:1787833935.254587:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381970560 00000100:00100000:0.0:1787833935.254642:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 184 00000100:00100000:0.0:1787833935.254658:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+63:12355:x1874679381970560:12345-192.168.203.17@tcp:58:lfs.0 00010000:00010000:0.0:1787833935.254798:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.254814:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.254824:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833935.254911:0:13407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787833935.254995:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+63:12355:x1874679381970560:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 345us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833935.255003:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 184 00000100:00100000:0.0:1787833935.283673:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833935.284019:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381970688 00000100:00100000:2.0:1787833935.284030:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381970688 00000100:00100000:2.0:1787833935.284115:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 185 00000100:00100000:2.0:1787833935.284127:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+63:12357:x1874679381970688:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833935.284148:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833935.284168:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1df73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91edfa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284233:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284248:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284260:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284271:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284277:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284283:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284368:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284378:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284385:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833935.284432:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787833935.284437:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833935.284455:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284468:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284476:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284481:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284487:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284493:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833935.284498:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284505:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284517:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:2.0:1787833935.284521:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833935.284525:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284531:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1df7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284554:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284560:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284566:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284571:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833935.284574:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284580:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284589:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69800) 00010000:00010000:2.0:1787833935.284591:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833935.284594:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284600:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1df81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284626:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1df73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edfa expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284638:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edfa expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.284655:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833935.284657:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833935.284659:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccde00, rc 0) 00000100:00100000:2.0:1787833935.284738:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12357:x1874679381970688:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 612us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.284746:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 185 00000040:00080000:2.0:1787833935.319147:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787833935.638035:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787833935.895022:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833935.895030:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833935.895192:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787833935.895199:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833935.895341:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213392c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406151168:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787833935.895468:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5024a89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833935.897566:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213392c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406151168:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787833935.898411:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833935.898548:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381970816 00000100:00100000:0.0:1787833935.898557:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381970816 00000100:00100000:0.0:1787833935.898626:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 186 00000100:00100000:0.0:1787833935.898714:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12368:x1874679381970816:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787833935.898863:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787833935.898981:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12368:x1874679381970816:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 345us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833935.899006:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 186 00000100:00100000:3.0:1787833935.902369:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833935.902445:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381970944 00000100:00100000:1.0:1787833935.902454:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381970944 00000100:00100000:1.0:1787833935.902544:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 187 00000100:00100000:1.0:1787833935.902555:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12368:x1874679381970944:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787833935.902624:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902641:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902652:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902678:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902694:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902702:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902737:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902778:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902787:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833935.902830:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787833935.902834:0:9772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833935.902846:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902859:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902866:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902873:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902880:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833935.902884:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902898:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902909:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:1.0:1787833935.902912:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833935.902917:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902933:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1df8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902944:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902950:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902955:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902960:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833935.902963:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902969:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902976:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8df503f0ea00) 00010000:00010000:1.0:1787833935.902979:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833935.902982:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.902988:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1df96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.903002:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.903008:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.903019:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.903025:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833935.903027:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.903034:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.903041:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:1.0:1787833935.903044:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833935.903047:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.903064:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1df9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833935.903148:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12368:x1874679381970944:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 595us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833935.903157:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 187 00000100:00100000:1.0:1787833935.905931:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833935.906010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381971200 00000100:00100000:2.0:1787833935.906019:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381971200 00000100:00100000:2.0:1787833935.906092:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 188 00000100:00100000:2.0:1787833935.906102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12368:x1874679381971200:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833935.906122:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833935.906141:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc200/0x996d2fb20dc1dfa4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee01 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906253:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906269:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906281:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833935.906292:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787833935.906369:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906397:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906404:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906410:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccdc00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833935.906414:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906422:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906434:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833935.906437:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833935.906442:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906448:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1dfab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906489:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc200/0x996d2fb20dc1dfa4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee01 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906499:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:2.0:1787833935.906502:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833935.906505:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc200/0x996d2fb20dc1dfa4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee01 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.906527:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccc200, rc 0) 00000100:00100000:2.0:1787833935.906594:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12368:x1874679381971200:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 493us (671us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1787833935.906602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 188 00000100:00100000:3.0:1787833935.911397:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833935.913613:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381971328 00000100:00100000:0.0:1787833935.913628:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381971328 00000100:00100000:0.0:1787833935.913841:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:0.0:1787833935.913852:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12368:x1874679381971328:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787833935.913890:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787833935.914018:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12368:x1874679381971328:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 168us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833935.914026:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:0.0:1787833935.919942:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833935.920007:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381971584 00000100:00100000:1.0:1787833935.920017:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381971584 00000100:00100000:1.0:1787833935.920079:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:1.0:1787833935.920098:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504571680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12368:x1874679381971584:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833935.920119:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833935.920122:0:9772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787833935.920146:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677a00/0x996d2fb20dc1df65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edf3 expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.920177:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:1.0:1787833935.920181:0:9772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833935.920196:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dfb9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee08 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787833935.920549:0:9772:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787833935.920692:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dfc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.920705:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.920715:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.920803:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1dfb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee08 expref: 67 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.920818:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dfc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee08 expref: 66 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.920826:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ea00) 00010000:00010000:1.0:1787833935.920828:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833935.920831:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722800, rc 0) 00000100:00100000:1.0:1787833935.920886:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504571680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12368:x1874679381971584:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 790us (964us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1787833935.920894:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:1.0:1787833935.924338:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833935.925307:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381971840 00000100:00100000:0.0:1787833935.925319:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381971840 00000100:00100000:0.0:1787833935.925427:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:0.0:1787833935.925438:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12368:x1874679381971840:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833935.925492:0:13407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833935.925516:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1dfc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee08 expref: 66 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.925533:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ea00) 00010000:00010000:0.0:1787833935.925543:0:13407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833935.925562:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.925575:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.925585:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.925673:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.925682:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.925689:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.925730:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.925737:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.925743:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931266:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833935.931280:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931295:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931316:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833935.931319:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833935.931325:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931332:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1dfce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931358:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931366:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931372:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931377:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833935.931380:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931387:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931396:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x63da1a1c (ffff8df502e69b00) 00010000:00010000:0.0:1787833935.931398:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833935.931402:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.931408:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676400/0x996d2fb20dc1dfd5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x63da1a1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833935.931518:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12368:x1874679381971840:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 6077us (7185us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833935.931528:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:3.0:1787833935.934274:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833935.935644:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381971968 00000100:00100000:1.0:1787833935.935656:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381971968 00000100:00100000:1.0:1787833935.935723:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 192 00000100:00100000:1.0:1787833935.935743:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12368:x1874679381971968:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833935.935990:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833935.936015:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dfdc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee0f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.936051:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.936064:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.936077:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.936183:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1dfdc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee0f expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.936202:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee0f expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.936211:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:1.0:1787833935.936214:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787833935.936217:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722e00, rc 0) 00000100:00100000:1.0:1787833935.936287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12368:x1874679381971968:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 546us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833935.936304:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 192 00000100:00100000:3.0:1787833935.942280:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833935.942321:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381972224 00000100:00100000:3.0:1787833935.942331:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381972224 00000100:00100000:3.0:1787833935.942382:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 193 00000100:00100000:3.0:1787833935.942391:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12368:x1874679381972224:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787833935.942465:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.942483:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.942495:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833935.942646:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787833935.942655:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411855903947ns, next at 412855901824ns, rc = 0 00000004:00010000:3.0:1787833935.942700:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045c60fc7 reply state 00000000281fb9d7 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.942713:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.942720:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:3.0:1787833935.942723:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787833935.942726:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833935.942838:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+68:12368:x1874679381972224:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 448us (565us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787833935.942846:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 193 00000100:00100000:1.0:1787833935.946284:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833935.946450:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381972352 00000100:00100000:3.0:1787833935.946468:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381972352 00000100:00100000:3.0:1787833935.946618:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 194 00000100:00100000:3.0:1787833935.946628:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df503ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+68:12368:x1874679381972352:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833935.946659:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833935.946677:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee16 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.946730:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee16 expref: 69 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.946744:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee16 expref: 69 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.946784:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:3.0:1787833935.946787:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833935.946791:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031000, rc 0) 00000100:00100000:3.0:1787833935.946847:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df503ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+69:12368:x1874679381972352:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 220us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833935.946854:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 194 00000100:00100000:2.0:1787833935.953130:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833935.953176:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381972480 00000100:00100000:2.0:1787833935.953184:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381972480 00000100:00100000:2.0:1787833935.953241:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:2.0:1787833935.953251:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+6:2400:x1874679381972480:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787833935.953452:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381972480:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 202us (330us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787833935.953461:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00080000:2.0:1787833935.953481:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787833935.955404:0:14654:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833935.955412:0:14654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833935.955436:0:14654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787833935.955442:0:14654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833935.960905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833935.961044:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381972736 00000100:00100000:0.0:1787833935.961062:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381972736 00000100:00100000:0.0:1787833935.961129:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:0.0:1787833935.961146:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+69:12368:x1874679381972736:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787833935.961354:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+70:12368:x1874679381972736:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 209us (456us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1787833935.961361:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:2.0:1787833935.964306:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833935.964369:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381972992 00000100:00100000:1.0:1787833935.964379:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381972992 00000100:00100000:1.0:1787833935.964443:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 195 00000100:00100000:1.0:1787833935.964453:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+70:12368:x1874679381972992:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787833935.964556:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+70:12368:x1874679381972992:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 104us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833935.964565:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 195 00000100:00100000:1.0:1787833935.971301:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833935.972022:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381973120 00000100:00100000:2.0:1787833935.972032:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381973120 00000100:00100000:2.0:1787833935.972264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 196 00000100:00100000:2.0:1787833935.972275:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+70:12368:x1874679381973120:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833935.972294:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833935.972314:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1dff8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee1d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.972381:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc000/0x996d2fb20dc1dfff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.972394:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc000/0x996d2fb20dc1dfff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.972418:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc000/0x996d2fb20dc1dfff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833935.972459:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833935.972477:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc000/0x996d2fb20dc1dfff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.972502:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1dff8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee1d expref: 72 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.972516:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc000/0x996d2fb20dc1dfff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee1d expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.972523:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:2.0:1787833935.972525:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787833935.972529:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccc000, rc 0) 00000100:00100000:2.0:1787833935.972591:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+71:12368:x1874679381973120:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 319us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.972599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 196 00000100:00100000:1.0:1787833935.977983:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833935.978275:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381973248 00000100:00100000:0.0:1787833935.978285:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381973248 00000100:00100000:0.0:1787833935.978343:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:0.0:1787833935.978353:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2401:x1874679381973248:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833935.978370:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833935.978388:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee24 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833935.978423:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902e50, blocks: 0x0 00010000:00010000:0.0:1787833935.978442:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1787833935.978446:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833935.978456:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee24 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.978472:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee24 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.978486:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676400, rc 0) 00000100:00100000:0.0:1787833935.978542:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2401:x1874679381973248:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 191us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833935.978549:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:3.0:1787833935.985777:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833935.988605:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381973504 00000100:00100000:2.0:1787833935.988616:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381973504 00000100:00100000:2.0:1787833935.988681:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 197 00000100:00100000:2.0:1787833935.988692:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+71:12368:x1874679381973504:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787833935.988807:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+71:12368:x1874679381973504:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 116us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.988816:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 197 00000100:00100000:0.0:1787833935.996976:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833935.997145:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381973632 00000100:00100000:3.0:1787833935.997154:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381973632 00000100:00100000:3.0:1787833935.999204:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:3.0:1787833935.999223:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df61189e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+8:12368:x1874679381973632:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833935.999241:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833935.999259:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee2b expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.999303:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee24 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.999312:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.999317:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.999322:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.999354:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee24 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.999368:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee24 expref: 9 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833935.999380:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874679406151296:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833935.999475:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5024a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787833936.004941:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874679406151296:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833936.004980:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.005002:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030600, rc 0) 00000100:00100000:3.0:1787833936.005077:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df61189e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:12368:x1874679381973632:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 5861us (8107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833936.005096:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:2.0:1787833936.005863:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833936.006144:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381973760 00000100:00100000:3.0:1787833936.006151:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381973760 00010000:00010000:3.0:1787833936.006184:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee24 expref: 9 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833936.006256:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:3.0:1787833936.006266:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e167450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381973760:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833936.006281:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833936.006302:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee24 expref: 9 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.006314:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee24 expref: 9 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.006335:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021d4fff5/0x996d2fb20dc1e006 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee24 expref: 9 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.006352:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833936.006356:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833936.006364:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.006373:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.006406:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833936.006426:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1874679406151424:192.168.203.17@tcp:105: 00000100:00100000:3.0:1787833936.006494:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5024a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787833936.010582:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1874679406151424:192.168.203.17@tcp:105: 00010000:00010000:3.0:1787833936.010612:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833936.010682:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e167450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381973760:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 4418us (4822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833936.010694:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:3.0:1787833936.015915:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833936.015950:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381973888 00000100:00100000:3.0:1787833936.015958:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381973888 00002000:00100000:3.0:1787833936.016006:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8df502ec5e00 x1874679381973888/t0(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:742/0 lens 504/0 e 0 to 0 dl 1787833947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833936.016017:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df502ec5e00 with x1874679381973888 ext(0->8) 00002000:00010000:3.0:1787833936.016022:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df502ec5e00 00000100:00100000:3.0:1787833936.016047:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1787833936.016070:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2401:x1874679381973888:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787833936.019727:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+10:2401:x1874679381973888:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 Request processed in 3648us (3811us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787833936.019742:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00002000:00100000:3.0:1787833936.019772:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8df502ec5e00 x1874679381973888/t4294967315(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:742/0 lens 504/448 e 0 to 0 dl 1787833947 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833936.019783:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df502ec5e00 with x1874679381973888 ext(0->8) 00002000:00010000:3.0:1787833936.019802:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df502ec5e00 00000100:00100000:2.0:1787833936.028536:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833936.028609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381974016 00000100:00100000:3.0:1787833936.028618:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381974016 00000100:00100000:3.0:1787833936.028677:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 198 00000100:00100000:3.0:1787833936.028686:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504615680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+71:12368:x1874679381974016:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787833936.031864:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1787833936.031879:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:2.0:1787833936.031944:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833936.031955:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:2.0:1787833936.031957:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.031966:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833936.031972:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df5024a8cc0 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:2.0:1787833936.031973:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722400 already unused, calling callback (ffffffffc18414f0) 00000020:00080000:3.0:1787833936.031980:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df612fc6600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df5024a86c0 00010000:00010000:2.0:1787833936.031981:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833936.031985:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df612fc6000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df602596200 00010000:00010000:2.0:1787833936.031997:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032015:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8df503f0eb00) 00010000:00010000:2.0:1787833936.032018:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833936.032023:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032030:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1dd35 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833936.032145:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:2.0:1787833936.032220:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032228:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032233:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032246:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833936.032249:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032255:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032264:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:2.0:1787833936.032266:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833936.032269:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032275:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1dd3c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032292:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032298:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032304:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032308:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833936.032311:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032317:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032334:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69800) 00010000:00010000:2.0:1787833936.032336:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833936.032340:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032345:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1dd7b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032362:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032368:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032373:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032377:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833936.032380:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032385:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032393:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833936.032395:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833936.032398:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032404:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1de7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032425:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032431:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032437:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032442:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00000020:00080000:3.0:1787833936.032443:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787833936.032445:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032454:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032463:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833936.032465:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833936.032468:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032475:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1dea1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032484:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032490:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032497:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032508:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833936.032512:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032518:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032527:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:2.0:1787833936.032529:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833936.032532:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032538:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676e00/0x996d2fb20dc1dee7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032551:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032557:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833936.032566:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504615680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+20:12368:x1874679381974016:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 3875us (4030us total) trans 0 rc 0/0 00010000:00010000:2.0:1787833936.032567:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032579:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030200 already unused, calling callback (ffffffffc18414f0) 00000100:00100000:3.0:1787833936.032583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 198 00010000:00010000:2.0:1787833936.032584:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032593:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032609:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:2.0:1787833936.032611:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787833936.032614:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032619:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1dfea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833936.032646:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df503f40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406151680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787833936.032700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833936.032739:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833936.032745:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406151552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787833936.032796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833936.032826:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406151680 00000100:00100000:2.0:1787833936.032833:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406151680 00000100:00100000:2.0:1787833936.032876:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406151552 00000100:00100000:2.0:1787833936.032879:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406151552 00000100:00100000:2.0:1787833936.032900:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787833936.032907:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406151680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787833936.032930:0:8432:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1787833936.032956:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a902e4d, atime: 0x6a902e4e, ctime: 0x6a902e4d, blocks: 0x8 00010000:00010000:2.0:1787833936.032962:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.032976:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1787833936.032980:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833936.032986:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.033006:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.033016:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.033022:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.033039:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787833936.034314:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3639:x1874679406151680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1402us (1609us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787833936.034325:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787833936.034346:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787833936.034355:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406151552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787833936.034436:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787833936.034440:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787833936 00002000:00010000:2.0:1787833936.034442:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787833936.034445:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787833936 -> 1787833936 00002000:00010000:2.0:1787833936.034447:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787833936.034473:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406151552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (1676us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787833936.034479:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1787833936.034497:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833936.034502:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787833936.034526:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833936.034534:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.034545:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccd800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833936.034550:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.034561:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833936.034567:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df620510f00/2, rc 0, transno 4294967316 00000100:00100000:3.0:1787833936.034576:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406151552:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787833936.034579:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.034588:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e014 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833936.034594:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df503f40f00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787833936.034600:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df503f40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406151680:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787833936.034606:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833936.034609:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833936.034611:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833936.038878:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833936.038962:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381974144 00000100:00100000:2.0:1787833936.038971:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381974144 00000100:00100000:2.0:1787833936.039032:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:2.0:1787833936.039042:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+10:2401:x1874679381974144:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787833936.040973:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1787833936.040984:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1787833936.042592:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2401:x1874679381974144:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 3541us (3711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833936.042608:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:3.0:1787833936.049820:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833936.049892:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381974400 00000100:00100000:2.0:1787833936.049902:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381974400 00000100:00100000:2.0:1787833936.049964:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 199 00000100:00100000:2.0:1787833936.049973:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504742580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+19:12368:x1874679381974400:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787833936.050022:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833936.050047:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc000/0x996d2fb20dc1dfff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee1d expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.050262:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:2.0:1787833936.050267:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833936.050296:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.050308:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.050317:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833936.050434:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000544e502 reply state 0000000061e50015 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.050447:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.050453:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:2.0:1787833936.050455:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787833936.050458:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833936.050555:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504742580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+20:12368:x1874679381974400:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 581us (742us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1787833936.050574:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 199 00000100:00100000:3.0:1787833936.055065:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833936.055152:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381974528 00000100:00100000:1.0:1787833936.055161:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381974528 00000100:00100000:1.0:1787833936.055219:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:1.0:1787833936.055229:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504740780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381974528:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787833936.055378:0:8583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787833936.055382:0:8583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787833936 -> 1787833935 00002000:00010000:1.0:1787833936.055385:0:8583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787833934 00002000:00010000:1.0:1787833936.055387:0:8583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787833936 -> 1787833935 00002000:00010000:1.0:1787833936.055389:0:8583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787833936.055447:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504740780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381974528:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 219us (404us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787833936.055462:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:2.0:1787833936.059276:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833936.059350:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381974784 00000100:00100000:0.0:1787833936.059360:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381974784 00000100:00100000:0.0:1787833936.059414:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 200 00000100:00100000:0.0:1787833936.059423:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+20:12368:x1874679381974784:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787833936.059487:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.059503:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee0f expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.059514:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.059548:0:13407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee0f expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.059563:0:13407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee0f expref: 20 pid: 6513 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833936.059576:0:13407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406151808:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833936.059652:0:13407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2480 going to sleep for 11 seconds 00000100:00100000:1.0:1787833936.068460:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833936.068496:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381974912 00000100:00100000:1.0:1787833936.068503:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381974912 00010000:00010000:1.0:1787833936.068540:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee0f expref: 21 pid: 6513 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833936.068577:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 89 00000100:00100000:1.0:1787833936.068587:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+21:2400:x1874679381974912:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833936.068605:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833936.068612:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee0f expref: 21 pid: 6513 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.068625:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee0f expref: 21 pid: 6513 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.068646:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:1.0:1787833936.068651:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.068659:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.068667:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.068684:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833936.068745:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+21:2400:x1874679381974912:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 159us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.068781:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 89 00010000:00010000:0.0:1787833936.069218:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1dfe3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee0f expref: 20 pid: 6513 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833936.069234:0:13407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406151808:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833936.069253:0:13407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.069273:0:13407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.069279:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.069316:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.069323:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.069330:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.069336:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833936.069340:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.069347:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.069358:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:0.0:1787833936.069361:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787833936.069365:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.069370:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677c00/0x996d2fb20dc1e022 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833936.069425:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+19:12368:x1874679381974784:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 Request processed in 10002us (10158us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787833936.069440:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 200 00000100:00100000:1.0:1787833936.077635:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833936.078628:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381975040 00000100:00100000:2.0:1787833936.078639:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381975040 00000100:00100000:2.0:1787833936.079405:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:2.0:1787833936.079416:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2398:x1874679381975040:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787833936.079462:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.079483:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.079491:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833936.079495:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833936.079500:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.079536:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.079550:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 8 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833936.079567:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874679406151936:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833936.079702:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b072900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833936.085577:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874679406151936:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833936.085605:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833936.092388:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833936.096051:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381975168 00000100:00100000:3.0:1787833936.096065:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381975168 00010000:00010000:3.0:1787833936.096123:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 9 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833936.096218:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00100000:3.0:1787833936.096229:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381975168:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833936.096244:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833936.096266:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 9 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.096281:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 9 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.096306:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1e00d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee2b expref: 9 pid: 8431 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.096324:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1787833936.096329:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1787833936.096335:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.096344:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.096379:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833936.096436:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381975168:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 209us (4056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833936.096444:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 90 00010000:00010000:2.0:1787833936.096503:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.096512:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.096530:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.096538:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.096546:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.096553:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccc000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833936.096557:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.096566:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.096580:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.096588:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007512a014/0x996d2fb20dc1e029 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833936.096644:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2398:x1874679381975040:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 17230us (19018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833936.096662:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:0.0:1787833936.102138:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833936.102406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381975424 00000100:00100000:3.0:1787833936.102414:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381975424 00000100:00100000:3.0:1787833936.102478:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 201 00000100:00100000:3.0:1787833936.102489:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50399d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+19:12368:x1874679381975424:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787833936.102566:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.102584:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edb4 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.102594:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.102627:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edb4 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.102641:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edb4 expref: 19 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833936.102667:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504743840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406152064:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833936.102773:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5024a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833936.107623:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833936.107667:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381975552 00000100:00100000:1.0:1787833936.107675:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381975552 00010000:00010000:1.0:1787833936.107715:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edb4 expref: 20 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833936.107772:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 91 00000100:00100000:1.0:1787833936.107783:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+20:2401:x1874679381975552:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833936.107798:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833936.107804:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edb4 expref: 20 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.107817:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edb4 expref: 20 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.107840:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:1.0:1787833936.107846:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.107866:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.107873:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.107891:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833936.107940:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+20:2401:x1874679381975552:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 159us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.107948:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 91 00010000:00010000:3.0:1787833936.108110:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1de77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edb4 expref: 19 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833936.108124:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504743840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406152064:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833936.108143:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.108162:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.108168:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.108312:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.108323:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee16 expref: 19 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.108330:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.108354:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee16 expref: 19 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.108366:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee16 expref: 19 pid: 13407 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833936.108377:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504743840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406152192:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833936.108433:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5024a89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833936.119742:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833936.119821:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504743840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406152192:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833936.119847:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833936.120110:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381975680 00000100:00100000:1.0:1787833936.120117:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381975680 00010000:00010000:1.0:1787833936.120153:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee16 expref: 20 pid: 13407 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833936.120195:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:1.0:1787833936.120204:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+20:2400:x1874679381975680:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833936.120218:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833936.120225:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee16 expref: 20 pid: 13407 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.120238:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee16 expref: 20 pid: 13407 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.120259:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1dff1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee16 expref: 20 pid: 13407 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.120288:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:1.0:1787833936.120292:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.120300:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.120308:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.120328:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833936.120377:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+19:2400:x1874679381975680:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 174us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.120385:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 92 00010000:00010000:2.0:1787833936.120584:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833936.120591:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833936.120702:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1787833936.120830:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1787833936.120866:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1787833936.121060:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c17840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1874679406152320:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787833936.121135:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833936.121165:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833936.127217:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406152320 00000100:00100000:1.0:1787833936.127230:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406152320 00000100:00100000:1.0:1787833936.130726:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787833936.130747:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1874679406152320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787833936.130903:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1874679406152320:12345-0@lo:1000:mdt00_001.0 Request processed in 165us (9768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.130911:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787833936.131155:0:6514:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1787833936.131162:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df620510f00, transno 4294967316 00000100:00100000:0.0:1787833936.131177:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c17840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1874679406152320:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787833936.131317:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1787833936.131383:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50399cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1874679406152448:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787833936.131424:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833936.134206:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833936.137298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406152448 00000100:00100000:2.0:1787833936.137309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406152448 00000100:00100000:2.0:1787833936.137357:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787833936.137366:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1874679406152448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787833936.137550:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6514:x1874679406152448:12345-0@lo:1000:mdt00_001.0 Request processed in 185us (6124us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787833936.137573:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787833936.137815:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50399cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1874679406152448:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787833936.137862:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.137872:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.137880:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.137886:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833936.137890:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.137897:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.137911:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:0.0:1787833936.137913:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833936.137924:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139616:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e037 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139648:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139720:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139726:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139731:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833936.139735:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139742:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139781:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:0.0:1787833936.139785:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833936.139790:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139796:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1df6c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139819:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139833:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edfa expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139852:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139894:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edfa expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.139908:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edfa expref: 22 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833936.139922:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406152576:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833936.140078:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833936.144744:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833936.145104:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874679406152576:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833936.145133:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833936.145205:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381975808 00000100:00100000:1.0:1787833936.145212:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381975808 00010000:00010000:1.0:1787833936.145253:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edfa expref: 23 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833936.145292:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:1.0:1787833936.145302:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+23:2400:x1874679381975808:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833936.145330:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833936.145337:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edfa expref: 23 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.145349:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edfa expref: 23 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.145371:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1df88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91edfa expref: 23 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.145386:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:1.0:1787833936.145391:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.145401:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.145408:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.145470:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833936.145529:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+22:2400:x1874679381975808:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 228us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.145537:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 93 00010000:00010000:3.0:1787833936.146505:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146527:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146540:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146547:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146554:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146559:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833936.146563:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146570:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146584:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:3.0:1787833936.146587:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833936.146591:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146596:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e03e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146610:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146616:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146626:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146631:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833936.146634:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146639:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146646:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df608e13100) 00010000:00010000:3.0:1787833936.146648:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787833936.146650:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833936.146722:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e030 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833936.146922:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50399d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+21:12368:x1874679381975424:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 44432us (44789us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787833936.147258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 201 00000020:00080000:3.0:1787833936.147263:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787833936.147412:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833936.147417:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833936.148186:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787833936.148198:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833936.149972:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833936.150100:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381976064 00000100:00100000:0.0:1787833936.150111:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381976064 00000100:00100000:0.0:1787833936.150171:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:0.0:1787833936.150182:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ecdf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+21:12368:x1874679381976064:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787833936.150422:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787833936.150452:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1787833936.150481:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.150495:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.150506:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.150514:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.150533:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.150540:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833936.150632:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787833936.150825:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ecdf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+23:12368:x1874679381976064:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 643us (857us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787833936.150834:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000020:00080000:0.0:1787833936.150839:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787833936.152057:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833936.152075:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.152095:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787833936.152099:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.152108:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.152124:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:1.0:1787833936.152127:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787833936.152132:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.152138:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e045 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833936.152149:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833936.152151:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833936.152152:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833936.213981:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833936.214005:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620510b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406152704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833936.214073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833936.214412:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406152832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787833936.214417:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406152704 00000100:00100000:1.0:1787833936.214423:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406152704 00000100:00100000:0.0:1787833936.214440:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833936.217186:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406152832 00000100:00100000:1.0:1787833936.217200:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406152832 00000100:00080000:0.0:1787833936.217257:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833936.217259:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787833936.217268:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620510f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406152704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833936.217294:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1787833936.217378:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620510f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406152704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.217386:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787833936.217417:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787833936.217423:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406152832:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833936.217429:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620510b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406152704:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833936.217434:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1787833936.217465:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635b38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406152832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.217472:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787833936.217488:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406152832:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787833936.666295:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833936.950212:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833936.950265:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833936.950300:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833936.950330:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833936.950356:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833936.950377:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833936.950414:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833936.950439:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381976448 00000100:00100000:0.0:1787833936.950448:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381976448 00000100:00100000:0.0:1787833936.950495:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381976960 00000100:00100000:0.0:1787833936.950497:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381976960 00000100:00100000:0.0:1787833936.950509:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381976320 00000100:00100000:0.0:1787833936.950511:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381976320 00000100:00100000:0.0:1787833936.950519:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381976832 00000100:00100000:0.0:1787833936.950521:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381976832 00000100:00100000:0.0:1787833936.950534:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 338 00000100:00100000:0.0:1787833936.950542:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620510b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381976448:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833936.950566:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381976704 00000100:00100000:1.0:1787833936.950573:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381976704 00000100:00100000:0.0:1787833936.950609:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620510b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381976448:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 66us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.950612:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381976576 00000100:00100000:1.0:1787833936.950617:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381976576 00000100:00100000:0.0:1787833936.950618:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 338 00000100:00100000:0.0:1787833936.950642:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 339 00000100:00100000:1.0:1787833936.950647:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:0.0:1787833936.950654:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381976960:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833936.950660:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2399:x1874679381976704:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833936.950694:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502f97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2399:x1874679381976704:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 38us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.950701:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:1.0:1787833936.950714:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:1.0:1787833936.950720:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2399:x1874679381976576:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833936.950794:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2399:x1874679381976576:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.950803:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:1.0:1787833936.950865:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 340 00000100:00100000:1.0:1787833936.950875:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+23:2399:x1874679381976320:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833936.950909:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381976960:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 257us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.950917:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+23:2399:x1874679381976320:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 44us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833936.950984:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 339 00000100:00100000:3.0:1787833936.951032:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381976192 00000100:00100000:3.0:1787833936.951036:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381976192 00000100:00100000:3.0:1787833936.951068:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 393 00000100:00100000:3.0:1787833936.951085:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381976192:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833936.951114:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381976192:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 40us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833936.951128:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 393 00000100:00100000:1.0:1787833936.953301:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 340 00000100:00100000:1.0:1787833936.953353:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 341 00000100:00100000:1.0:1787833936.953364:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381976832:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787833936.953444:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381976832:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 84us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833936.953451:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 341 00000100:00080000:1.0:1787833936.953481:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833936.953486:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833936.953489:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787833937.690155:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787833937.745785:0:14706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833937.745794:0:14706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833937.745819:0:14706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787833937.745824:0:14706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833937.843295:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833937.843468:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381977216 00000100:00100000:0.0:1787833937.843478:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381977216 00000100:00100000:0.0:1787833937.843581:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 202 00000100:00100000:0.0:1787833937.843593:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+23:12387:x1874679381977216:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833937.843612:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833937.843632:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e04c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee32 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.843779:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1e053 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.843794:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1e053 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.843806:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1e053 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833937.843818:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787833937.844050:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e04c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee32 expref: 26 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.844078:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1e053 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee32 expref: 25 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.844088:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833937.844092:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787833937.844095:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676800, rc 0) 00000100:00100000:0.0:1787833937.844155:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+25:12387:x1874679381977216:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 565us (870us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787833937.844163:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 202 00000100:00080000:1.0:1787833937.846109:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833937.846935:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833937.847017:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381977344 00000100:00100000:0.0:1787833937.847027:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381977344 00000100:00100000:0.0:1787833937.847087:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 203 00000100:00100000:0.0:1787833937.847097:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+25:12387:x1874679381977344:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:0.0:1787833937.847170:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847193:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847205:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847222:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847230:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847236:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847298:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847307:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847314:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833937.847353:0:13407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847470:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847479:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847496:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847502:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833937.847505:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847512:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847525:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833937.847528:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833937.847533:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847538:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e061 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847550:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847555:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847562:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847566:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833937.847569:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847583:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847590:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69300) 00010000:00010000:0.0:1787833937.847593:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833937.847596:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847601:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e068 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847614:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847621:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847627:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847632:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833937.847635:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847641:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847647:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69a00) 00010000:00010000:0.0:1787833937.847650:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833937.847652:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.847666:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e06f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833937.848777:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+25:12387:x1874679381977344:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 1673us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833937.848790:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 203 00000100:00100000:3.0:1787833937.905282:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833937.905448:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381977600 00000100:00100000:0.0:1787833937.905457:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381977600 00000100:00100000:0.0:1787833937.905515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 204 00000100:00100000:0.0:1787833937.905526:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+25:12390:x1874679381977600:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833937.905545:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833937.905564:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e076 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee39 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905649:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905664:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905676:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905690:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905698:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905723:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905868:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905877:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905885:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833937.905894:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787833937.905966:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905974:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905980:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905986:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833937.905991:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.905998:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906009:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833937.906012:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833937.906022:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906028:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e07d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906042:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906048:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906053:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906058:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833937.906060:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906065:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906084:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69a00) 00010000:00010000:0.0:1787833937.906086:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833937.906089:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906095:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e084 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906133:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e076 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee39 expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906159:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee39 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.906166:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:0.0:1787833937.906168:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833937.906170:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677200, rc 0) 00000100:00100000:0.0:1787833937.906244:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12390:x1874679381977600:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 720us (972us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787833937.906251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 204 00000100:00100000:1.0:1787833937.912270:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833937.913407:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381977728 00000100:00100000:3.0:1787833937.913417:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381977728 00000100:00100000:3.0:1787833937.913481:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 205 00000100:00100000:3.0:1787833937.913492:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12390:x1874679381977728:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:3.0:1787833937.913555:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.913573:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.913584:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.913618:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.913625:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.913631:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.913637:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833937.913650:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.913658:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.913668:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:3.0:1787833937.913671:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833937.913675:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.913681:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e099 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833937.913773:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12390:x1874679381977728:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 282us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833937.913794:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 205 00000100:00100000:1.0:1787833937.918328:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833937.918398:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381977984 00000100:00100000:3.0:1787833937.918406:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381977984 00000100:00100000:3.0:1787833937.918463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:3.0:1787833937.918472:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12390:x1874679381977984:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787833937.918674:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+28:12390:x1874679381977984:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 203us (354us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787833937.918682:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:3.0:1787833937.969521:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833937.969668:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381978240 00000100:00100000:0.0:1787833937.969678:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381978240 00000100:00100000:0.0:1787833937.969793:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 206 00000100:00100000:0.0:1787833937.969806:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+28:11913:x1874679381978240:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1787833937.969831:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833937.969941:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e0a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee40 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833937.970059:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833937.970082:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee39 expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833937.970091:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833937.970121:0:13407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee39 expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833937.970135:0:13407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee39 expref: 29 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833937.970164:0:13407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504602580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406152960:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833937.970267:0:13407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833937.980222:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833937.980395:0:13407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504602580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406152960:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833937.980420:0:13407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833937.980740:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381978368 00000100:00100000:2.0:1787833937.980747:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381978368 00010000:00010000:2.0:1787833937.980814:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee39 expref: 30 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833937.980840:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:2.0:1787833937.980846:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+30:2401:x1874679381978368:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833937.980857:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833937.980863:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee39 expref: 30 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833937.980872:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee39 expref: 30 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833937.980891:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e08b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee39 expref: 30 pid: 6514 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833937.980902:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:2.0:1787833937.980905:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833937.980911:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833937.980916:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833937.980941:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833937.980986:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+29:2401:x1874679381978368:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 139us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833937.980992:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 94 00010000:00010000:0.0:1787833937.981025:0:13407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.981033:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833937.981052:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787833937.981181:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e0a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee40 expref: 30 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.981205:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee40 expref: 29 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.981212:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:0.0:1787833937.981215:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787833937.981217:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722800, rc 0) 00000100:00100000:0.0:1787833937.981256:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+29:11913:x1874679381978240:12345-192.168.203.17@tcp:101:bash.0 Request processed in 11454us (11747us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1787833937.981263:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 206 00000100:00100000:1.0:1787833937.987253:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833937.987357:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381978496 00000100:00100000:3.0:1787833937.987366:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381978496 00000100:00100000:3.0:1787833937.987421:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 207 00000100:00100000:3.0:1787833937.987431:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504603c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+29:11913:x1874679381978496:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833937.987464:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833937.987483:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.987516:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e0bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.987530:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e0bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.987541:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e0bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.987840:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee47 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.987858:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e0bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee47 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833937.987867:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:3.0:1787833937.987870:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787833937.987873:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031c00, rc 0) 00000100:00100000:3.0:1787833937.988033:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504603c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+30:11913:x1874679381978496:12345-192.168.203.17@tcp:101:bash.0 Request processed in 602us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833937.988040:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 207 00000100:00100000:3.0:1787833937.990910:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833937.991943:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381978752 00000100:00100000:0.0:1787833937.991963:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381978752 00000100:00100000:0.0:1787833937.992025:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 208 00000100:00100000:0.0:1787833937.992036:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+30:11913:x1874679381978752:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:0.0:1787833937.992255:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.992271:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.992283:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833937.992320:0:9772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1787833937.992340:0:9772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2dbf23b reply state 000000006f549f70 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.992352:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833937.992374:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:0.0:1787833937.992377:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787833937.992380:0:9772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787833937.992418:0:9772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1787833937.992521:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+34:11913:x1874679381978752:12345-192.168.203.17@tcp:36:bash.0 Request processed in 486us (1619us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787833937.992529:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 208 00000020:00080000:0.0:1787833937.992534:0:9772:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787833937.998132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833937.998266:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381978880 00000100:00100000:1.0:1787833937.998275:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381978880 00000100:00100000:1.0:1787833937.998385:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:1.0:1787833937.998396:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+34:11913:x1874679381978880:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833937.998417:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833937.998436:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e0ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee4e expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833937.998489:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e0ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee4e expref: 35 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833937.998503:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e0ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee4e expref: 35 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833937.998520:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:1.0:1787833937.998523:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833937.998527:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723a00, rc 0) 00000100:00100000:1.0:1787833937.998582:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+35:11913:x1874679381978880:12345-192.168.203.17@tcp:101:bash.0 Request processed in 188us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833937.998589:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:1.0:1787833938.002079:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.002192:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381979008 00000100:00100000:2.0:1787833938.002201:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381979008 00000100:00100000:2.0:1787833938.002309:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:2.0:1787833938.002318:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504602d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:11913:x1874679381979008:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1787833938.002335:0:8583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833938.002356:0:8583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee55 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833938.002381:0:8583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a902e4f, atime: 0x6a902e4e, ctime: 0x6a902e4f, blocks: 0x8 00010000:00010000:2.0:1787833938.002402:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1787833938.002407:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833938.002414:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee55 expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.002429:0:8583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee55 expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.002442:0:8583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccd000, rc 0) 00000100:00100000:2.0:1787833938.002519:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504602d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:11913:x1874679381979008:12345-192.168.203.17@tcp:101:bash.0 Request processed in 202us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833938.002526:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00080000:1.0:1787833938.003059:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833938.004862:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833938.004966:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381979136 00000100:00100000:0.0:1787833938.004974:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381979136 00002000:00010000:0.0:1787833938.005015:0:8436:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787833938.005020:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504743840 with x1874679381979136 ext(0->18446744073709551615) 00002000:00010000:0.0:1787833938.005033:0:8436:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504743840. 00000100:00100000:0.0:1787833938.005076:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1787833938.005086:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504743840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2399:x1874679381979136:12345-192.168.203.17@tcp:10:bash.0 00002000:00010000:0.0:1787833938.005335:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787833938.005339:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787833935 -> 1787833938 00002000:00010000:0.0:1787833938.005341:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787833934 -> 1787833934 00002000:00010000:0.0:1787833938.005344:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787833935 -> 1787833938 00002000:00010000:0.0:1787833938.005346:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787833938.005964:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504743840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2399:x1874679381979136:12345-192.168.203.17@tcp:10:bash.0 Request processed in 875us (1106us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787833938.005974:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00002000:00010000:0.0:1787833938.005979:0:8436:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787833938.005982:0:8436:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504743840 with x1874679381979136 ext(0->18446744073709551615) 00002000:00010000:0.0:1787833938.006000:0:8436:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504743840. 00000100:00100000:0.0:1787833938.064325:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.064406:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381979264 00000100:00100000:3.0:1787833938.064416:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381979264 00000100:00100000:3.0:1787833938.064496:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:3.0:1787833938.064506:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+35:12404:x1874679381979264:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:3.0:1787833938.064574:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064591:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064604:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064619:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064627:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064633:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064702:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064712:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064719:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833938.064806:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064818:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064831:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064837:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064843:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.064847:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064855:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064868:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:3.0:1787833938.064871:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.064876:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064882:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064896:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064901:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064907:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064912:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.064932:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064939:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064947:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502d22a00) 00010000:00010000:3.0:1787833938.064949:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.064952:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064958:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064972:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064977:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064982:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064987:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.064990:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.064995:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.065002:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:3.0:1787833938.065004:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.065014:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.065019:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.065101:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+35:12404:x1874679381979264:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 597us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.065109:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:1.0:1787833938.116891:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.116957:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381979520 00000100:00100000:3.0:1787833938.116966:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381979520 00000100:00100000:3.0:1787833938.117032:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 211 00000100:00100000:3.0:1787833938.117042:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504602940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+35:12407:x1874679381979520:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787833938.117063:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833938.117092:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee5c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117161:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117176:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117189:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117204:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117224:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117246:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117348:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1e102 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117357:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1e102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117364:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1e102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833938.117375:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787833938.117446:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117454:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117461:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117467:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.117472:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117480:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117492:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:3.0:1787833938.117495:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.117506:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117513:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e0f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117529:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117535:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117542:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117547:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.117551:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117557:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117565:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502d22a00) 00010000:00010000:3.0:1787833938.117567:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.117570:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117576:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e0fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117658:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e0ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee5c expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117685:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1e102 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee5c expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.117692:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:3.0:1787833938.117695:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787833938.117697:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031800, rc 0) 00000100:00100000:3.0:1787833938.117811:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504602940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+37:12407:x1874679381979520:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 770us (929us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787833938.117819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 211 00000100:00100000:1.0:1787833938.121049:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833938.121156:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381979648 00000100:00100000:0.0:1787833938.121166:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381979648 00000100:00100000:0.0:1787833938.121229:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 212 00000100:00100000:0.0:1787833938.121240:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+37:12407:x1874679381979648:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:0.0:1787833938.121304:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.121319:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee40 expref: 37 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.121328:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.121382:0:13407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee40 expref: 37 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.121395:0:13407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee40 expref: 37 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833938.121408:0:13407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504cc7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406153088:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833938.121503:0:13407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833938.127130:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.128125:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381979904 00000100:00100000:3.0:1787833938.128136:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381979904 00000100:00100000:3.0:1787833938.128199:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:3.0:1787833938.128321:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+38:6173:x1874679381979904:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787833938.128600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+39:6173:x1874679381979904:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 391us (1479us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787833938.128609:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:0.0:1787833938.131045:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.131143:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381980032 00000100:00100000:2.0:1787833938.131151:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381980032 00010000:00010000:2.0:1787833938.131191:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee40 expref: 39 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833938.131243:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00100000:2.0:1787833938.131253:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e165850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+39:2400:x1874679381980032:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833938.131269:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833938.131276:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee40 expref: 39 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.131289:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee40 expref: 39 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.131313:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:2.0:1787833938.131319:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.131328:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.131336:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.131354:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833938.131409:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e165850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+39:2400:x1874679381980032:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 157us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833938.131416:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 95 00010000:00010000:1.0:1787833938.132894:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e0a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee40 expref: 38 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833938.132978:0:13407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504cc7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406153088:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787833938.133003:0:13407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.133013:0:13407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.133019:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.133056:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.133063:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.133079:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.133086:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833938.133090:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.133097:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.133135:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:1.0:1787833938.133138:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833938.133143:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.133149:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1e110 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833938.133339:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+37:12407:x1874679381979648:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 12099us (12297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.133349:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 212 00000100:00100000:0.0:1787833938.138687:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.138935:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381980288 00000100:00100000:2.0:1787833938.138959:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381980288 00000100:00100000:2.0:1787833938.139016:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:2.0:1787833938.139027:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+37:12407:x1874679381980288:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1787833938.140194:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+38:12407:x1874679381980288:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 1164us (1511us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787833938.140205:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:0.0:1787833938.240476:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.240570:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381980544 00000100:00100000:3.0:1787833938.240580:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381980544 00000100:00100000:3.0:1787833938.240649:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 213 00000100:00100000:3.0:1787833938.240659:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+38:12418:x1874679381980544:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:3.0:1787833938.240682:0:9772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833938.240701:0:9772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e117 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee63 expref: -99 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.240816:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.240844:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.240854:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.240870:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.240877:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.240883:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.240999:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e12c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241009:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e12c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241016:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e12c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833938.241026:0:9772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787833938.241110:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241117:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241124:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241137:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.241141:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241149:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241161:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:3.0:1787833938.241164:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.241168:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241175:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e11e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241188:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241193:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241198:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241203:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.241206:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241218:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241236:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502d22a00) 00010000:00010000:3.0:1787833938.241239:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.241242:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241247:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e125 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241288:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e117 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee63 expref: 41 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241302:0:9772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e12c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee63 expref: 40 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.241309:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:3.0:1787833938.241311:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833938.241313:0:9772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030600, rc 0) 00000100:00100000:3.0:1787833938.241371:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+40:12418:x1874679381980544:12345-192.168.203.17@tcp:101:cat.0 Request processed in 714us (903us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787833938.241377:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 213 00000100:00100000:0.0:1787833938.250276:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.250376:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381980800 00000100:00100000:3.0:1787833938.250385:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381980800 00000100:00100000:3.0:1787833938.250444:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:3.0:1787833938.250454:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+40:12418:x1874679381980800:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:3.0:1787833938.250968:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+41:12418:x1874679381980800:12345-192.168.203.17@tcp:35:cat.0 Request processed in 505us (690us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787833938.250977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:0.0:1787833938.262153:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833938.262177:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406153216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833938.262244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833938.262573:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406153216 00000100:00100000:2.0:1787833938.262581:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406153216 00000100:00100000:2.0:1787833938.262631:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787833938.262641:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406153216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833938.262674:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833938.262916:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406153216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 276us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833938.262923:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787833938.266226:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406153216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787833938.277688:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.277969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381981056 00000100:00100000:2.0:1787833938.277978:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381981056 00000100:00100000:2.0:1787833938.278082:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 214 00000100:00100000:2.0:1787833938.278093:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+41:12419:x1874679381981056:12345-192.168.203.17@tcp:36:rm.0 00010000:00010000:2.0:1787833938.278152:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787833938.278176:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e0ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee4e expref: 41 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278197:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030600/0x996d2fb20dc1e12c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee63 expref: 40 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278211:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1e102 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee5c expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278244:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e0bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee47 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278254:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:2.0:1787833938.278258:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833938.278278:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278289:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278306:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278319:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278326:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278333:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278402:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278410:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278416:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787833938.278620:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787833938.278827:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414192075450ns, next at 415191997370ns, rc = 0 00010000:00010000:2.0:1787833938.278884:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278893:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278901:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278909:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278926:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278933:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278959:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833938.278976:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278983:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278989:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.278995:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccca00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833938.279006:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279013:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279023:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:2.0:1787833938.279025:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787833938.279028:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279034:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e148 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279048:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279054:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279059:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279078:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccd400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833938.279082:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279090:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.279097:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833938.279098:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:2.0:1787833938.279104:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833938.279108:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279116:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.279118:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccc400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787833938.279125:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279127:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e13a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.279140:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833938.279146:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fe80e2e reply state 00000000b4c707c7 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.279153:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:0.0:1787833938.279158:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787833938.279163:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279169:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.279171:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e14f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.279186:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df608e13300) 00010000:00010000:2.0:1787833938.279190:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833938.279192:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833938.279194:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787833938.279195:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833938.279198:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833938.279274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+39:12419:x1874679381981056:12345-192.168.203.17@tcp:36:rm.0 Request processed in 1181us (1594us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787833938.279281:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 214 00000100:00100000:0.0:1787833938.328705:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833938.329173:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381981312 00000100:00100000:1.0:1787833938.329182:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381981312 00000100:00100000:1.0:1787833938.329279:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 215 00000100:00100000:1.0:1787833938.329290:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+39:12425:x1874679381981312:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787833938.329322:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833938.329344:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1e156 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee6a expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.329443:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.329457:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.329470:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.329500:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.329507:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.329513:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787833938.329842:0:13407:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787833938.330223:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330233:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330241:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330272:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330279:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330285:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330291:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833938.330400:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330421:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330433:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:1.0:1787833938.330436:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833938.330440:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330447:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e15d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833938.330461:0:13407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f6bd5f4 reply state 00000000733d809c transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330471:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330478:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df608e13300) 00010000:00010000:1.0:1787833938.330480:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833938.330482:0:13407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787833938.330510:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1e156 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee6a expref: 42 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330524:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee6a expref: 41 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.330531:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0e300) 00010000:00010000:1.0:1787833938.330532:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833938.330535:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722000, rc 0) 00000100:00100000:1.0:1787833938.330607:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+42:12425:x1874679381981312:12345-192.168.203.17@tcp:101:bash.0 Request processed in 1320us (1910us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787833938.330615:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 215 00000100:00100000:0.0:1787833938.334496:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.334787:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381981440 00000100:00100000:3.0:1787833938.334796:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381981440 00000100:00100000:3.0:1787833938.334862:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:3.0:1787833938.334873:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2398:x1874679381981440:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833938.334890:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833938.334910:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee71 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833938.334942:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787833938.334960:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833938.334964:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833938.334974:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee71 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.334991:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee71 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.335005:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031600, rc 0) 00000100:00100000:3.0:1787833938.335078:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2398:x1874679381981440:12345-192.168.203.17@tcp:101:bash.0 Request processed in 208us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.335085:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00080000:1.0:1787833938.335805:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833938.337975:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.338081:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381981568 00000100:00100000:2.0:1787833938.338090:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381981568 00000100:00100000:2.0:1787833938.338142:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:2.0:1787833938.338152:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:12425:x1874679381981568:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1787833938.338168:0:8583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833938.338186:0:8583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee78 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.338215:0:8583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee71 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.338225:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833938.338241:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833938.338247:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 9 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.338279:0:8583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee71 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.338293:0:8583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee71 expref: 9 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833938.338307:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbfc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8583:1874679406153344:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833938.338400:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787833938.340909:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.341005:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381981696 00000100:00100000:3.0:1787833938.341013:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381981696 00010000:00010000:3.0:1787833938.341047:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee71 expref: 10 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.341108:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 96 00000100:00100000:3.0:1787833938.341125:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+10:2400:x1874679381981696:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833938.341140:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833938.341162:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee71 expref: 10 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.341177:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee71 expref: 10 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.341202:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833938.341206:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833938.341214:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 10 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.341224:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 10 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.341257:0:8457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 10 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.341271:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8457:1874679406153472:192.168.203.17@tcp:105: 00000100:00100000:3.0:1787833938.341345:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112eee40 going to sleep for 11 seconds 00010000:00010000:2.0:1787833938.341867:0:8583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001479d797/0x996d2fb20dc1e179 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee71 expref: 10 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833938.341884:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbfc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8583:1874679406153344:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833938.341906:0:8583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 9 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.342116:0:8583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccd400, rc 0) 00000100:00100000:2.0:1787833938.342159:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+9:12425:x1874679381981568:12345-192.168.203.17@tcp:101:bash.0 Request processed in 4009us (4193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833938.342167:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:3.0:1787833938.346702:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8457:1874679406153472:192.168.203.17@tcp:105: 00010000:00010000:3.0:1787833938.346730:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833938.349911:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381981696:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 8777us (8999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.349953:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 96 00000100:00100000:0.0:1787833938.350288:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.351319:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381981952 00000100:00100000:2.0:1787833938.351330:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381981952 00000100:00100000:2.0:1787833938.351430:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:2.0:1787833938.351450:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+42:12425:x1874679381981952:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:2.0:1787833938.351764:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+43:12425:x1874679381981952:12345-192.168.203.17@tcp:35:bash.0 Request processed in 299us (1461us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787833938.351772:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:0.0:1787833938.484398:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833938.484584:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381982080 00000100:00100000:1.0:1787833938.484592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381982080 00000100:00100000:1.0:1787833938.484675:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 216 00000100:00100000:1.0:1787833938.484686:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+43:12441:x1874679381982080:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833938.485007:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833938.485042:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee7f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.485145:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e18e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.485160:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e18e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.485172:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e18e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833938.485340:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787833938.485346:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833938.485370:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e18e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.485397:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee7f expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.485417:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e18e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee7f expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.485436:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:1.0:1787833938.485440:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833938.485443:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722e00, rc 0) 00000100:00100000:1.0:1787833938.485558:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+44:12441:x1874679381982080:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 873us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.485566:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 216 00000100:00100000:1.0:1787833938.498250:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.498353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381982336 00000100:00100000:2.0:1787833938.498362:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381982336 00000100:00100000:2.0:1787833938.498419:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 217 00000100:00100000:2.0:1787833938.498429:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+44:12441:x1874679381982336:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833938.498449:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833938.498469:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e195 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.498582:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e19c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.498596:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e19c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.498608:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e19c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833938.498618:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787833938.498982:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccca00/0x996d2fb20dc1e195 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee86 expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.498999:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e19c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee86 expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.499036:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0e300) 00010000:00010000:2.0:1787833938.499039:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833938.499043:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccc400, rc 0) 00000100:00100000:2.0:1787833938.499116:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+46:12441:x1874679381982336:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 688us (874us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1787833938.499123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 217 00000100:00100000:0.0:1787833938.507264:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833938.507311:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833938.507602:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381982720 00000100:00100000:1.0:1787833938.507622:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381982720 00000100:00100000:1.0:1787833938.507706:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 218 00000100:00100000:1.0:1787833938.507718:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+46:12441:x1874679381982720:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833938.507742:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833938.507938:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e1aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee8d expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.508040:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.508054:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.508075:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833938.508088:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787833938.508199:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e1aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee8d expref: 49 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.508659:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee8d expref: 48 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.508669:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0e300) 00010000:00010000:1.0:1787833938.508672:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787833938.508676:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723c00, rc 0) 00000100:00100000:1.0:1787833938.508743:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+48:12441:x1874679381982720:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1027us (1486us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1787833938.509173:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 218 00000100:00100000:2.0:1787833938.509382:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381982464 00000100:00100000:2.0:1787833938.509389:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381982464 00000100:00100000:2.0:1787833938.509479:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1787833938.509490:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+48:2400:x1874679381982464:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833938.509503:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833938.509524:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc400/0x996d2fb20dc1e19c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee86 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.509538:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0e300) 00010000:00010000:2.0:1787833938.509542:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833938.509582:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+47:2400:x1874679381982464:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 95us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833938.509589:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:0.0:1787833938.519637:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833938.519689:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381982848 00000100:00100000:1.0:1787833938.519699:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381982848 00000100:00100000:1.0:1787833938.519793:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:1.0:1787833938.519804:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2401:x1874679381982848:12345-192.168.203.17@tcp:1:lfs.0 00010000:00010000:1.0:1787833938.519848:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.519866:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.519874:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833938.519878:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833938.519883:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.519915:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 8 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.519943:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 8 pid: 8583 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833938.519957:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504603480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1874679406153600:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787833938.520061:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833938.528288:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504603480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1874679406153600:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833938.528318:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833938.528514:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.528588:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381982976 00000100:00100000:3.0:1787833938.528596:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381982976 00002000:00100000:3.0:1787833938.528828:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8df504cc6580 x1874679381982976/t0(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:744/0 lens 504/0 e 0 to 0 dl 1787833949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833938.528838:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504cc6580 with x1874679381982976 ext(0->8) 00010000:00010000:3.0:1787833938.528846:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 9 pid: 8583 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.528862:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 9 pid: 8583 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833938.528869:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df504cc6580 00000100:00100000:3.0:1787833938.528904:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:3.0:1787833938.528914:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381982976:12345-192.168.203.17@tcp:4:lfs.0 00000100:00100000:3.0:1787833938.530593:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2400:x1874679381982976:12345-192.168.203.17@tcp:4:lfs.0 Request processed in 1672us (2073us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787833938.530605:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00002000:00100000:3.0:1787833938.530615:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8df504cc6580 x1874679381982976/t4294967309(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:744/0 lens 504/448 e 0 to 0 dl 1787833949 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833938.531205:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504cc6580 with x1874679381982976 ext(0->8) 00010000:00010000:3.0:1787833938.531226:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 11 pid: 8583 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.531244:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 11 pid: 8583 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833938.531251:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df504cc6580 00000100:00100000:1.0:1787833938.534491:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.534669:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381983104 00000100:00100000:2.0:1787833938.534679:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381983104 00010000:00010000:2.0:1787833938.534718:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 11 pid: 8583 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833938.534803:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:2.0:1787833938.534826:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504603840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2401:x1874679381983104:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833938.534842:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787833938.534861:0:6500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787833938.534865:0:6500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787833938 00002000:00010000:2.0:1787833938.534867:0:6500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787833938 00002000:00010000:2.0:1787833938.534869:0:6500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787833938 00002000:00010000:2.0:1787833938.534871:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787833938.534878:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 11 pid: 8583 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.534893:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 11 pid: 8583 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.534927:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b70d95e/0x996d2fb20dc1e180 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee78 expref: 11 pid: 8583 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.534945:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833938.534949:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833938.534955:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.534965:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.534994:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833938.535042:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504603840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+10:2401:x1874679381983104:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 217us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833938.535058:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 97 00010000:00010000:3.0:1787833938.535343:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.535354:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.535374:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.535383:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.535391:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.535398:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787833938.535402:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.535418:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.535430:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.535437:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1e1bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.535484:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2401:x1874679381982848:12345-192.168.203.17@tcp:1:lfs.0 Request processed in 15682us (15854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.535502:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:0.0:1787833938.546930:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.547036:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381983360 00000100:00100000:3.0:1787833938.547050:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381983360 00000100:00100000:3.0:1787833938.547124:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:3.0:1787833938.547133:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ecdec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+47:12441:x1874679381983360:12345-192.168.203.17@tcp:35:lfs.0 00000004:00010000:3.0:1787833938.547193:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee8d expref: 47 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833938.547347:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1787833938.547370:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787833938.547656:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1787833938.547693:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.547708:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee6a expref: 51 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.547731:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.547807:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee6a expref: 51 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.547822:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee6a expref: 51 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.547836:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874679406153728:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833938.548048:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112eee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833938.550836:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.551100:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874679406153728:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833938.551126:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833938.551626:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381983488 00000100:00100000:2.0:1787833938.551634:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381983488 00010000:00010000:2.0:1787833938.551671:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee6a expref: 52 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833938.551930:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00100000:2.0:1787833938.551943:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+52:2401:x1874679381983488:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833938.551959:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833938.551967:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee6a expref: 52 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.551980:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee6a expref: 52 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.552004:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e16b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee6a expref: 52 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.552021:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0e300) 00010000:00010000:2.0:1787833938.552146:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.552157:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.552166:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.552216:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833938.552441:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+51:2401:x1874679381983488:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 500us (1615us total) trans 0 rc 0/0 00010000:00010000:3.0:1787833938.552463:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.552471:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833938.552572:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1787833938.553081:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1787833938.553171:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406153856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787833938.553229:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833938.553264:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6112ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833938.553278:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406153856 00000100:00100000:0.0:1787833938.553284:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406153856 00000100:00100000:0.0:1787833938.553341:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787833938.553350:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fba21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6516:x1874679406153856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833938.553427:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fba21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6516:x1874679406153856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833938.553434:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1787833938.553928:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833938.554318:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504787480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406153856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787833938.554470:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1787833938.554526:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fba2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406153984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787833938.554570:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833938.554603:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27300 going to sleep for 11 seconds 00000100:00100000:0.0:1787833938.554836:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406153984 00000100:00100000:0.0:1787833938.554842:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406153984 00000100:00100000:0.0:1787833938.554880:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787833938.554889:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1874679406153984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833938.555003:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6516:x1874679406153984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (433us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787833938.555010:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787833938.555260:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fba2d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874679406153984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787833938.557169:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1787833938.557233:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.557245:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.557252:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.557257:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.557262:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.557270:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.557287:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0e300) 00010000:00010000:3.0:1787833938.557290:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787833938.557294:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.557300:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1c6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833938.557419:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787833938.557478:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787833938.557488:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414470737152ns, next at 415470734796ns, rc = 0 00000001:00080000:3.0:1787833938.557494:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1787833938.557519:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0e300) 00010000:00010000:3.0:1787833938.557522:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787833938.557529:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee8d expref: 56 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.557655:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ecdec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+55:12441:x1874679381983360:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 10522us (10733us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787833938.557664:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00000020:00080000:3.0:1787833938.557668:0:6516:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787833938.560270:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00100000:0.0:1787833938.560388:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833938.560725:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381983616 00000100:00100000:1.0:1787833938.560734:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381983616 00000100:00100000:1.0:1787833938.561021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 219 00000100:00100000:1.0:1787833938.561033:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+54:12441:x1874679381983616:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833938.561073:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833938.561095:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1e1cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee94 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.561151:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1e1cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee94 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.561167:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1e1cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee94 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.561184:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833938.561187:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833938.561191:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723000, rc 0) 00000100:00100000:1.0:1787833938.561254:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+55:12441:x1874679381983616:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 224us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.561275:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 219 00000100:00100000:0.0:1787833938.563876:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.564011:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381983872 00000100:00100000:3.0:1787833938.564020:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381983872 00000100:00100000:3.0:1787833938.564094:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:3.0:1787833938.564105:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+55:12441:x1874679381983872:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787833938.564312:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+56:12441:x1874679381983872:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 207us (443us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787833938.564320:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:0.0:1787833938.651255:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.651346:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381984000 00000100:00100000:3.0:1787833938.651355:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381984000 00000100:00100000:3.0:1787833938.651414:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 220 00000100:00100000:3.0:1787833938.651424:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+56:12451:x1874679381984000:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:3.0:1787833938.651487:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651513:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651524:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651536:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651543:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651549:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651620:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651628:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651634:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833938.651678:0:9772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651691:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651697:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651713:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651719:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.651724:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651731:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651743:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:3.0:1787833938.651746:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.651779:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651787:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e1d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651801:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651808:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651814:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651819:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.651822:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651838:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651846:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df608e13300) 00010000:00010000:3.0:1787833938.651849:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.651852:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651857:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e1db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651868:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651874:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651879:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651883:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787833938.651886:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651891:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651898:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:3.0:1787833938.651900:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833938.651902:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.651917:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e1e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.652090:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+56:12451:x1874679381984000:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 666us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.652098:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 220 00000100:00100000:0.0:1787833938.715940:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:2.0:1787833938.716023:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833938.716115:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381984256 00000100:00100000:1.0:1787833938.716125:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381984256 00000100:00100000:1.0:1787833938.716310:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 221 00000100:00100000:1.0:1787833938.716322:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+56:12454:x1874679381984256:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833938.716341:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833938.716359:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e1e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ee9b expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716427:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716442:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716453:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716463:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716471:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716477:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716579:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716606:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716614:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833938.716623:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787833938.716698:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716705:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716712:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716717:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833938.716720:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716727:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716738:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:1.0:1787833938.716741:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833938.716745:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716791:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e1f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716804:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716816:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716822:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716828:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833938.716833:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716839:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716847:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df608e13300) 00010000:00010000:1.0:1787833938.716849:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833938.716853:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716858:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e1f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716893:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e1e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee9b expref: 59 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716906:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee9b expref: 58 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.716913:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833938.716915:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833938.716924:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723c00, rc 0) 00000100:00100000:1.0:1787833938.716979:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+58:12454:x1874679381984256:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 660us (1048us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787833938.716987:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 221 00000100:00100000:0.0:1787833938.724712:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833938.735944:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381984384 00000100:00100000:1.0:1787833938.735958:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381984384 00000100:00100000:1.0:1787833938.736082:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 222 00000100:00100000:1.0:1787833938.736094:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+58:12454:x1874679381984384:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1787833938.736162:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.736179:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.736190:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.736223:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.736230:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.736236:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.736243:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833938.736247:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.736254:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.736282:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833938.736285:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833938.736290:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.736297:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e20c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833938.736373:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+58:12454:x1874679381984384:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 281us (11669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.736380:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 222 00000100:00100000:0.0:1787833938.743993:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.744145:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381984640 00000100:00100000:3.0:1787833938.744156:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381984640 00000100:00100000:3.0:1787833938.744211:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:3.0:1787833938.744222:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504cc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+58:12454:x1874679381984640:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787833938.744457:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504cc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+59:12454:x1874679381984640:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 236us (472us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1787833938.744465:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:0.0:1787833938.775275:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833938.775314:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406154240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833938.775431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833938.775547:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406154240 00000100:00100000:0.0:1787833938.775553:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406154240 00000100:00100000:0.0:1787833938.775607:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787833938.775632:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3641:x1874679406154240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833938.775668:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833938.775729:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3641:x1874679406154240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833938.775737:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787833938.775884:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406154240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833938.776087:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833938.776104:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406154112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833938.776162:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833938.776327:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406154112 00000100:00100000:3.0:1787833938.776335:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406154112 00000100:00100000:3.0:1787833938.776407:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787833938.776421:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406154112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787833938.776447:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833938.776513:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406154112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.776522:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1787833938.776548:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833938.776572:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406154112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833938.777272:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406154752:0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.777318:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833938.777357:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406155264:0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.777383:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833938.777402:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787833938.777407:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406154368:0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.777456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833938.777501:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406154880:0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.777541:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833938.777557:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406155392:0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.777581:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833938.777640:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406154368 00000100:00100000:1.0:1787833938.777651:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406154368 00000100:00100000:1.0:1787833938.777718:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787833938.777726:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406154368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.778143:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ef20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3640:x1874679406154368:12345-0@lo:400:kworker.0 Request processed in 414us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.778156:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787833938.778310:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406154368:0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.778340:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406154752 00000100:00100000:1.0:1787833938.778344:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406154752 00000100:00100000:1.0:1787833938.778370:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406154880 00000100:00100000:1.0:1787833938.778373:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406154880 00000100:00100000:1.0:1787833938.778394:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406155392 00000100:00100000:1.0:1787833938.778397:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406155392 00000100:00100000:1.0:1787833938.778410:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787833938.778416:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406154752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.778463:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406154752:12345-0@lo:400:kworker.0 Request processed in 47us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.778470:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787833938.778496:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406154752:0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.778517:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787833938.778524:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406154880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.778557:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406154880:12345-0@lo:400:kworker.0 Request processed in 34us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.778563:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787833938.778577:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787833938.778583:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406155392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.778613:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e1d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406155392:12345-0@lo:400:kworker.0 Request processed in 29us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.778736:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406155264 00000100:00100000:3.0:1787833938.778740:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406155264 00000100:00100000:3.0:1787833938.778793:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787833938.778799:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406155264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.778833:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406155264:12345-0@lo:400:kworker.0 Request processed in 34us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.778838:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787833938.778856:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833938.778860:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833938.778870:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406154496:0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.778899:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833938.778912:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406155008:0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.778945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833938.778961:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406155520:0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.778982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833938.778998:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787833938.779003:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406154624:0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833938.779047:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406155136:0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833938.779102:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406154624 00000100:00100000:3.0:1787833938.779106:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406154624 00000100:00100000:3.0:1787833938.779131:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787833938.779138:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406154624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779174:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406154624:12345-0@lo:400:kworker.0 Request processed in 37us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.779181:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787833938.779211:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406154624:0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779238:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406154496 00000100:00100000:3.0:1787833938.779241:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406154496 00000100:00100000:3.0:1787833938.779258:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406155008 00000100:00100000:3.0:1787833938.779261:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406155008 00000100:00100000:3.0:1787833938.779278:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406155520 00000100:00100000:3.0:1787833938.779281:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406155520 00000100:00100000:3.0:1787833938.779296:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787833938.779302:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406154496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779338:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406154496:12345-0@lo:400:kworker.0 Request processed in 36us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.779345:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787833938.779357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787833938.779363:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406155008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779390:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406155008:12345-0@lo:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.779396:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787833938.779407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787833938.779413:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406155520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779438:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406155520:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.779443:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:3.0:1787833938.779456:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787833938.779474:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406154496:0@lo:400:kworker.0 00010000:00080000:3.0:1787833938.779485:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504dbf480 x1874679406155008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833938.779495:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406155008:0@lo:400:kworker.0 00010000:00080000:3.0:1787833938.779515:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504dbe1c0 x1874679406155520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833938.779524:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406155520:0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779586:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406154880:0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779598:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406155392:0@lo:400:kworker.0 00000100:00100000:3.0:1787833938.779609:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406155264:0@lo:400:kworker.0 00000100:00100000:2.0:1787833938.779737:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406155136 00000100:00100000:2.0:1787833938.779742:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406155136 00000100:00100000:2.0:1787833938.779797:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787833938.779805:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406155136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833938.779846:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406155136:12345-0@lo:400:kworker.0 Request processed in 42us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833938.779852:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1787833938.779866:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833938.779883:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406155136:0@lo:400:kworker.0 00000100:00100000:1.0:1787833938.779974:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787833938.821952:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.822051:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381984896 00000100:00100000:3.0:1787833938.822072:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381984896 00000100:00100000:3.0:1787833938.822135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 223 00000100:00100000:3.0:1787833938.822145:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+59:12464:x1874679381984896:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833938.822167:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833938.822170:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787833938.822197:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e18e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee7f expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.822216:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:3.0:1787833938.822221:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833938.822234:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e213 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eea2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.822342:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.822357:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee9b expref: 59 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.822384:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.822416:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee9b expref: 59 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.822429:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee9b expref: 59 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.822442:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406155648:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833938.822855:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787833938.830139:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.830143:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406155648:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833938.830172:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833938.830737:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381985024 00000100:00100000:1.0:1787833938.830747:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381985024 00010000:00010000:1.0:1787833938.830807:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee9b expref: 60 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833938.830847:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 99 00000100:00100000:1.0:1787833938.830856:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+60:2400:x1874679381985024:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833938.830871:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833938.830877:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee9b expref: 60 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.830890:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee9b expref: 60 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.830910:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e1fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee9b expref: 60 pid: 13407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.830924:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833938.830929:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.830937:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.830945:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.830990:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833938.831047:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+59:2400:x1874679381985024:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 192us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.831071:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 99 00010000:00010000:3.0:1787833938.832655:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.832671:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833938.833448:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787833938.833587:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e213 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea2 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.833608:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea2 expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.833633:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:3.0:1787833938.833636:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787833938.833639:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031200, rc 0) 00000100:00100000:3.0:1787833938.833958:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+59:12464:x1874679381984896:12345-192.168.203.17@tcp:101:bash.0 Request processed in 11812us (12012us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787833938.833967:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 223 00000100:00100000:2.0:1787833938.846835:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833938.847743:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381985152 00000100:00100000:0.0:1787833938.847807:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381985152 00000100:00100000:0.0:1787833938.847874:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 224 00000100:00100000:0.0:1787833938.847886:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+59:12464:x1874679381985152:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1787833938.847908:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833938.847928:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1e228 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.847963:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.847977:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.847988:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.848120:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1e228 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea9 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.848139:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea9 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833938.848148:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:0.0:1787833938.848151:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787833938.848154:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677e00, rc 0) 00000100:00100000:0.0:1787833938.848234:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+60:12464:x1874679381985152:12345-192.168.203.17@tcp:101:bash.0 Request processed in 350us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833938.848242:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 224 00000100:00100000:0.0:1787833938.856143:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833938.856242:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381985408 00000100:00100000:1.0:1787833938.856251:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381985408 00000100:00100000:1.0:1787833938.856319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 225 00000100:00100000:1.0:1787833938.856330:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+60:12464:x1874679381985408:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:1.0:1787833938.856567:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.856585:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.856607:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833938.856646:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1787833938.856668:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000299d15be reply state 000000001a189c97 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.856680:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.856687:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833938.856689:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833938.856693:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833938.856832:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+63:12464:x1874679381985408:12345-192.168.203.17@tcp:36:bash.0 Request processed in 503us (697us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787833938.856856:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 225 00000020:00080000:1.0:1787833938.856862:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787833938.863886:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.864241:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381985536 00000100:00100000:3.0:1787833938.864251:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381985536 00000100:00100000:3.0:1787833938.864307:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 226 00000100:00100000:3.0:1787833938.864318:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+63:12464:x1874679381985536:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787833938.864340:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833938.864360:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e23d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eeb0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.864444:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.864457:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea2 expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.864465:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.864497:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea2 expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.864510:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea2 expref: 64 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.864550:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406155776:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833938.864631:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787833938.871900:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.872202:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874679406155776:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833938.872230:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833938.872245:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381985664 00000100:00100000:1.0:1787833938.872253:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381985664 00010000:00010000:1.0:1787833938.872289:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea2 expref: 65 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833938.872329:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00100000:1.0:1787833938.872338:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+65:2401:x1874679381985664:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833938.872351:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833938.872367:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea2 expref: 65 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.872380:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea2 expref: 65 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.872400:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031200/0x996d2fb20dc1e21a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea2 expref: 65 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.872415:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833938.872419:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.872427:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.872434:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.872632:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833938.872683:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+64:2401:x1874679381985664:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 346us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.872691:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 100 00010000:00010000:3.0:1787833938.873431:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.873442:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833938.873494:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787833938.873499:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787833938.873516:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.873549:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e23d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb0 expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.873566:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb0 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.873575:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:3.0:1787833938.873577:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833938.873580:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031a00, rc 0) 00000100:00100000:3.0:1787833938.873628:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+63:12464:x1874679381985536:12345-192.168.203.17@tcp:101:bash.0 Request processed in 9311us (9750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.873654:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 226 00000100:00100000:2.0:1787833938.876026:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.876430:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381985920 00000100:00100000:3.0:1787833938.876439:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381985920 00000100:00100000:3.0:1787833938.876494:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:3.0:1787833938.876505:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+63:12464:x1874679381985920:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:2.0:1787833938.877333:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12464:x1874679381985920:12345-192.168.203.17@tcp:35:bash.0 Request processed in 825us (1315us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787833938.877342:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:0.0:1787833938.948847:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.948958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381986048 00000100:00100000:2.0:1787833938.948981:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381986048 00000100:00100000:2.0:1787833938.949097:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 227 00000100:00100000:2.0:1787833938.949108:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+64:12470:x1874679381986048:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833938.949130:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833938.949150:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e24b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eeb7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.949216:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1e252 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.949230:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1e252 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.949242:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1e252 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833938.949284:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787833938.949289:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833938.949307:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1e252 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.949328:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e24b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb7 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.949343:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1e252 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb7 expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.949352:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:2.0:1787833938.949355:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833938.949359:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccde00, rc 0) 00000100:00100000:2.0:1787833938.949425:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12470:x1874679381986048:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 319us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833938.949433:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 227 00000100:00100000:0.0:1787833938.953391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833938.953482:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381986176 00000100:00100000:1.0:1787833938.953492:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381986176 00000100:00100000:1.0:1787833938.953554:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 228 00000100:00100000:1.0:1787833938.953564:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12470:x1874679381986176:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833938.953584:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833938.953615:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e259 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eebe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953677:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953691:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953701:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953711:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953718:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953725:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953840:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953850:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953856:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833938.953896:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787833938.953901:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833938.953918:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953932:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953939:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953946:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953952:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953958:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833938.953962:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953969:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.953989:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:1.0:1787833938.953992:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833938.953997:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954003:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1e260 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954016:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954021:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954027:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954032:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833938.954035:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954041:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954048:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df608e13300) 00010000:00010000:1.0:1787833938.954050:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833938.954053:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954058:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1e267 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954110:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e259 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954123:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.954131:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833938.954133:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833938.954136:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722000, rc 0) 00000100:00100000:1.0:1787833938.954199:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12470:x1874679381986176:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 636us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.954207:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 228 00000100:00100000:0.0:1787833938.957676:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833938.958747:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.958853:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381986560 00000100:00100000:2.0:1787833938.958863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381986560 00000100:00100000:2.0:1787833938.958985:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 229 00000100:00100000:2.0:1787833938.958996:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12470:x1874679381986560:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787833938.959016:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833938.959034:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc000/0x996d2fb20dc1e275 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eec5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.959146:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.959162:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb0 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.959170:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.959178:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.959211:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.959226:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 67 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833938.959257:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbde00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406155904:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833938.959348:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb0 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.959359:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb0 expref: 67 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833938.959378:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406156032:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833938.959402:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833938.960636:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381986304 00000100:00100000:1.0:1787833938.960647:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381986304 00010000:00010000:1.0:1787833938.960685:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 68 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833938.960718:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:1.0:1787833938.960727:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e166450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+68:2399:x1874679381986304:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833938.960739:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833938.960746:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 68 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.960781:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 68 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.960832:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833938.960837:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.960846:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.960853:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833938.960895:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e166450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+68:2399:x1874679381986304:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 168us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.960902:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:0.0:1787833938.964584:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.964794:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406156032:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833938.964812:0:6513:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.17@tcp) returned -22 from blocking AST (req@0000000023c958ba x1874679406155904) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 67 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.964831:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1e26e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eebe expref: 67 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833938.964848:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbde00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874679406155904:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833938.964869:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:2.0:1787833938.964874:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.964884:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.964911:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.965121:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381986688 00000100:00100000:3.0:1787833938.965129:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381986688 00010000:00010000:3.0:1787833938.965163:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb0 expref: 67 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833938.965478:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:3.0:1787833938.965488:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+67:2401:x1874679381986688:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833938.965503:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833938.965510:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb0 expref: 67 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.965521:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb0 expref: 67 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.965541:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e244 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb0 expref: 67 pid: 6515 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.965555:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:3.0:1787833938.965559:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.965567:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.965583:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.965710:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833938.965818:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+66:2401:x1874679381986688:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 331us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.965826:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 102 00010000:00010000:2.0:1787833938.965947:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.965954:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833938.965970:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787833938.966246:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc000/0x996d2fb20dc1e275 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eec5 expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.966263:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eec5 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.966270:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:2.0:1787833938.966273:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787833938.966275:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccc600, rc 0) 00000100:00100000:2.0:1787833938.966688:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12470:x1874679381986560:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 7692us (7941us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787833938.966697:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 229 00000100:00100000:0.0:1787833938.978840:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833938.979387:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381986944 00000100:00100000:2.0:1787833938.979397:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381986944 00000100:00100000:2.0:1787833938.979463:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1787833938.979473:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12470:x1874679381986944:12345-192.168.203.17@tcp:103:lfs.0 00010000:00010000:2.0:1787833938.979488:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833938.979521:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1e1cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee94 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833938.979537:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:2.0:1787833938.979542:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833938.979602:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12470:x1874679381986944:12345-192.168.203.17@tcp:103:lfs.0 Request processed in 130us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833938.979610:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:0.0:1787833938.985828:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833938.985927:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381987072 00000100:00100000:1.0:1787833938.985937:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381987072 00000100:00100000:1.0:1787833938.985992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 230 00000100:00100000:1.0:1787833938.986003:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12470:x1874679381987072:12345-192.168.203.17@tcp:58:lfs.0 00010000:00010000:1.0:1787833938.986117:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.986135:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833938.986146:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787833938.986244:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787833938.986845:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12470:x1874679381987072:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 841us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.986853:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 230 00000100:00100000:0.0:1787833938.990739:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833938.990874:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381987200 00000100:00100000:3.0:1787833938.990884:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381987200 00000100:00100000:3.0:1787833938.990944:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 231 00000100:00100000:3.0:1787833938.990954:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+65:12470:x1874679381987200:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787833938.990984:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833938.991007:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eecc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.991072:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.991084:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eecc expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.991101:0:6515:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.991114:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eecc expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.991127:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:3.0:1787833938.991142:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833938.991147:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eecc expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833938.991156:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031a00, rc 0) 00000100:00100000:3.0:1787833938.991217:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12470:x1874679381987200:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 265us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833938.991224:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 231 00000040:00080000:3.0:1787833939.221961:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833939.221971:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833939.221998:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787833939.222005:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833939.222139:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406156160:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787833939.222244:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27540 going to sleep for 11 seconds 00000100:00100000:3.0:1787833939.230785:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406156160:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787833939.242611:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.242702:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381987328 00000100:00100000:0.0:1787833939.242711:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381987328 00000100:00100000:0.0:1787833939.242807:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 232 00000100:00100000:0.0:1787833939.242817:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12471:x1874679381987328:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787833939.242847:0:6513:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787833939.242985:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12471:x1874679381987328:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 169us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.242993:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 232 00000100:00080000:2.0:1787833939.243159:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833939.254469:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.254572:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381987456 00000100:00100000:2.0:1787833939.254583:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381987456 00000100:00100000:2.0:1787833939.254641:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 233 00000100:00100000:2.0:1787833939.254650:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12471:x1874679381987456:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787833939.254718:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254735:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254784:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254800:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254807:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254814:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254852:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254862:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254869:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833939.254912:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787833939.254917:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787833939.254929:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254940:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254946:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254952:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254958:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccda00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833939.254962:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254969:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.254993:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:2.0:1787833939.255002:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833939.255007:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255014:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e298 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255233:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255239:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255245:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255250:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccce00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833939.255253:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255258:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255267:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8df608e13500) 00010000:00010000:2.0:1787833939.255283:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833939.255286:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255399:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccce00/0x996d2fb20dc1e29f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255415:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255427:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255433:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255438:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccc800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833939.255440:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255446:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255454:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:2.0:1787833939.255456:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833939.255459:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.255464:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc800/0x996d2fb20dc1e2a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.255529:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12471:x1874679381987456:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 879us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.255537:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 233 00000100:00100000:1.0:1787833939.264867:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.264984:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381987712 00000100:00100000:0.0:1787833939.264994:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381987712 00000100:00100000:0.0:1787833939.265075:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 234 00000100:00100000:0.0:1787833939.265086:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504603840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+66:12471:x1874679381987712:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833939.265106:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833939.265124:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1e2ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eed3 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265227:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265241:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265252:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833939.265261:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787833939.265618:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265625:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265632:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265653:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833939.265657:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265663:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265674:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:0.0:1787833939.265677:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787833939.265681:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265688:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265730:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1e2ad lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eed3 expref: 68 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265741:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00010000:00010000:0.0:1787833939.265744:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787833939.265747:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676a00/0x996d2fb20dc1e2ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eed3 expref: 68 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.265805:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676a00, rc 0) 00000100:00100000:0.0:1787833939.265906:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504603840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+67:12471:x1874679381987712:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 821us (1046us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1787833939.265914:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 234 00000100:00100000:0.0:1787833939.276476:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833939.276628:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381987840 00000100:00100000:3.0:1787833939.276637:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381987840 00000100:00100000:3.0:1787833939.276695:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 235 00000100:00100000:3.0:1787833939.276705:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+67:12471:x1874679381987840:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787833939.276738:0:9772:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787833939.276952:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+67:12471:x1874679381987840:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 248us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833939.276959:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 235 00000001:00080000:2.0:1787833939.289896:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1787833939.289921:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787833939.292966:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833939.293052:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381988096 00000100:00100000:1.0:1787833939.293070:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381988096 00000100:00100000:1.0:1787833939.293128:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 236 00000100:00100000:1.0:1787833939.293139:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+67:12471:x1874679381988096:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833939.293160:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833939.293163:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787833939.293189:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccde00/0x996d2fb20dc1e252 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeb7 expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.293208:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:1.0:1787833939.293214:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833939.293228:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e2c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eeda expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787833939.293565:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787833939.293690:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e2c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.293703:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.293713:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.293809:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1e2c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeda expref: 69 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.293825:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e2c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeda expref: 68 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.293845:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df503f0e800) 00010000:00010000:1.0:1787833939.293848:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833939.293851:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723a00, rc 0) 00000100:00100000:1.0:1787833939.293913:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+68:12471:x1874679381988096:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 776us (954us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787833939.293920:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 236 00000100:00100000:1.0:1787833939.308522:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.309019:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381988352 00000100:00100000:0.0:1787833939.309029:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381988352 00000100:00100000:0.0:1787833939.309157:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 237 00000100:00100000:0.0:1787833939.309168:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+68:12471:x1874679381988352:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833939.309228:0:13407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833939.309253:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e2c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeda expref: 68 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309287:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df503f0e800) 00010000:00010000:0.0:1787833939.309304:0:13407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833939.309324:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309337:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309347:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309360:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309368:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309374:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309415:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309441:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309447:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309453:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833939.309457:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309465:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309473:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833939.309475:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833939.309479:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309485:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309518:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309524:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309529:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309534:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833939.309543:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309550:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309558:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6215a5c3 (ffff8df502e69a00) 00010000:00010000:0.0:1787833939.309561:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833939.309563:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.309569:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2de lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6215a5c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.309654:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+67:12471:x1874679381988352:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 488us (1142us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833939.309661:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 237 00000100:00100000:0.0:1787833939.314272:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.316053:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381988480 00000100:00100000:2.0:1787833939.316078:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381988480 00000100:00100000:2.0:1787833939.316147:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 238 00000100:00100000:2.0:1787833939.316170:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+67:12471:x1874679381988480:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833939.316189:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833939.316212:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e2e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eee1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.316247:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.316259:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.316283:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.316687:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e2e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee1 expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.316704:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee1 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.316713:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:2.0:1787833939.316716:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787833939.316719:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccdc00, rc 0) 00000100:00100000:2.0:1787833939.317042:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+68:12471:x1874679381988480:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 872us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.317050:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 238 00000100:00100000:2.0:1787833939.320573:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.321339:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381988736 00000100:00100000:0.0:1787833939.321350:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381988736 00000100:00100000:0.0:1787833939.321480:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 239 00000100:00100000:0.0:1787833939.321499:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+68:12471:x1874679381988736:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833939.321577:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.321592:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.321603:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833939.322180:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1787833939.322190:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 415235438864ns, next at 416235435984ns, rc = 0 00000004:00010000:0.0:1787833939.322235:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000870badb1 reply state 00000000b1e7733a transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.322250:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.322258:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:0.0:1787833939.322261:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787833939.322265:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833939.322435:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+70:12471:x1874679381988736:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 944us (1869us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787833939.322444:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 239 00000100:00100000:1.0:1787833939.329397:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.330158:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381988864 00000100:00100000:0.0:1787833939.330168:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381988864 00000100:00100000:0.0:1787833939.330271:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 240 00000100:00100000:0.0:1787833939.330283:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+70:12471:x1874679381988864:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833939.330304:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833939.330323:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eee8 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.330390:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee8 expref: 71 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.330404:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee8 expref: 71 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.330443:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:0.0:1787833939.330446:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833939.330450:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676200, rc 0) 00000100:00100000:0.0:1787833939.330517:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+71:12471:x1874679381988864:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 237us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.330525:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 240 00000100:00100000:2.0:1787833939.335885:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833939.336081:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381988992 00000100:00100000:3.0:1787833939.336091:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381988992 00000100:00100000:3.0:1787833939.336149:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:3.0:1787833939.336159:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2400:x1874679381988992:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787833939.336666:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+10:2400:x1874679381988992:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 507us (788us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787833939.336675:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:2.0:1787833939.340012:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.340237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381989248 00000100:00100000:0.0:1787833939.340248:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381989248 00000100:00100000:0.0:1787833939.340478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:0.0:1787833939.340490:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+71:12471:x1874679381989248:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787833939.340698:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+72:12471:x1874679381989248:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 210us (694us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787833939.340707:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:1.0:1787833939.351098:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.351428:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381989504 00000100:00100000:2.0:1787833939.351437:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381989504 00000100:00100000:2.0:1787833939.351491:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 241 00000100:00100000:2.0:1787833939.351501:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504603c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+72:12471:x1874679381989504:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787833939.351604:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504603c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+72:12471:x1874679381989504:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 104us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.351611:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 241 00000100:00100000:1.0:1787833939.354226:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.360644:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381989632 00000100:00100000:0.0:1787833939.360658:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381989632 00000100:00100000:1.0:1787833939.360974:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 242 00000100:00100000:1.0:1787833939.360987:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504602940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+72:12471:x1874679381989632:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833939.361018:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833939.361040:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1e301 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eeef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.361117:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e308 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.361131:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.361142:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833939.361177:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787833939.361204:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.361223:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723800/0x996d2fb20dc1e301 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeef expref: 74 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.361235:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e308 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeef expref: 73 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.361240:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:1.0:1787833939.361242:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787833939.361245:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722c00, rc 0) 00000100:00100000:1.0:1787833939.361319:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504602940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+73:12471:x1874679381989632:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 336us (7101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.361326:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 242 00000100:00100000:0.0:1787833939.375240:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.380702:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381989760 00000100:00100000:2.0:1787833939.380720:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381989760 00000100:00100000:2.0:1787833939.380864:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:2.0:1787833939.380875:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+10:2399:x1874679381989760:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833939.380908:0:8583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833939.380934:0:8583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eef6 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833939.380966:0:8583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902e53, blocks: 0x0 00010000:00010000:2.0:1787833939.380992:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787833939.380998:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833939.381010:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eef6 expref: 11 pid: 8583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.381032:0:8583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eef6 expref: 11 pid: 8583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.381048:0:8583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccd600, rc 0) 00000100:00100000:2.0:1787833939.381144:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2399:x1874679381989760:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 271us (5920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.381168:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:0.0:1787833939.384821:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833939.385124:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381990016 00000100:00100000:3.0:1787833939.385137:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381990016 00000100:00100000:3.0:1787833939.385318:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 243 00000100:00100000:3.0:1787833939.385330:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+73:12471:x1874679381990016:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787833939.385489:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+73:12471:x1874679381990016:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 162us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833939.385498:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 243 00000100:00100000:1.0:1787833939.388944:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.389149:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381990144 00000100:00100000:2.0:1787833939.389159:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381990144 00000100:00100000:2.0:1787833939.389220:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:2.0:1787833939.389230:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+11:12471:x1874679381990144:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833939.389246:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833939.389264:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91eefd expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.389594:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eef6 expref: 12 pid: 8583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.389604:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833939.389608:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833939.389784:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.389822:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eef6 expref: 12 pid: 8583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.389836:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eef6 expref: 12 pid: 8583 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.389851:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbe940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874679406156288:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833939.390172:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787833939.408398:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbe940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874679406156288:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833939.408439:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833939.408446:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:2.0:1787833939.408466:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccda00, rc 0) 00000100:00100000:2.0:1787833939.408534:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+12:12471:x1874679381990144:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 19304us (19597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.408543:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381990272 00000100:00100000:2.0:1787833939.408544:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:0.0:1787833939.408552:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381990272 00010000:00010000:0.0:1787833939.408586:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eef6 expref: 12 pid: 8583 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.408627:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 103 00000100:00100000:0.0:1787833939.408636:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+12:2401:x1874679381990272:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833939.408649:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833939.408682:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eef6 expref: 12 pid: 8583 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.408695:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eef6 expref: 12 pid: 8583 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.408716:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da5e55bf/0x996d2fb20dc1e30f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eef6 expref: 12 pid: 8583 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.408729:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833939.408733:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833939.408741:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.408781:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.408813:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.408826:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c58f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6498:1874679406156416:192.168.203.17@tcp:105: 00000100:00100000:0.0:1787833939.408877:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833939.413787:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c58f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6498:1874679406156416:192.168.203.17@tcp:105: 00010000:00010000:1.0:1787833939.413816:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833939.413870:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2401:x1874679381990272:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 5234us (5428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.413880:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 103 00000100:00100000:1.0:1787833939.429579:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833939.429693:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381990400 00000100:00100000:3.0:1787833939.429703:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381990400 00002000:00100000:3.0:1787833939.429851:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8df504600000 x1874679381990400/t0(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:745/0 lens 504/0 e 0 to 0 dl 1787833950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833939.429862:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504600000 with x1874679381990400 ext(0->12) 00002000:00010000:3.0:1787833939.429868:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504600000 00000100:00100000:2.0:1787833939.430018:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:2.0:1787833939.430029:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+11:2401:x1874679381990400:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787833939.430897:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+13:2401:x1874679381990400:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 Request processed in 858us (1315us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787833939.430921:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00002000:00100000:2.0:1787833939.430934:0:8437:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8df504600000 x1874679381990400/t4294967321(0) o4->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:745/0 lens 504/448 e 0 to 0 dl 1787833950 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787833939.430944:0:8437:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504600000 with x1874679381990400 ext(0->12) 00002000:00010000:2.0:1787833939.430951:0:8437:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504600000 00000100:00100000:2.0:1787833939.435461:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833939.435667:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381990528 00000100:00100000:3.0:1787833939.435675:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381990528 00000100:00100000:3.0:1787833939.435732:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 244 00000100:00100000:3.0:1787833939.435743:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+73:12471:x1874679381990528:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787833939.445070:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1787833939.445088:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1787833939.445132:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787833939.445155:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df6112ee6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787833939.445160:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df612fc6100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df6112ee840 00000020:00080000:3.0:1787833939.445180:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df63b101d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df608f20400 00000004:00080000:3.0:1787833939.445210:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787833939.445232:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df602df2840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787833939.445235:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df6051d4c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df602df2480 00000020:00080000:3.0:1787833939.445238:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df6051d4f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df6202c8000 00000020:00080000:3.0:1787833939.445258:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787833939.445552:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787833939.445635:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787833939.445794:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12471:x1874679381990528:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 10047us (10337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833939.445804:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 244 00000100:00100000:2.0:1787833939.446006:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833939.446035:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406156544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787833939.446127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833939.446249:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406156544 00000100:00100000:0.0:1787833939.446257:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406156544 00000100:00100000:0.0:1787833939.446488:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787833939.446499:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406156544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787833939.446536:0:8583:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1787833939.446568:0:8583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a902e52, atime: 0x6a902e52, ctime: 0x6a902e52, blocks: 0x8 00010000:00010000:0.0:1787833939.446577:0:8583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446595:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1787833939.446599:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833939.446606:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446621:0:8583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446630:0:8583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446637:0:8583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446655:0:8583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787833939.446829:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1874679406156544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 332us (702us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787833939.446836:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1787833939.446857:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833939.446863:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446883:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787833939.446888:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446897:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446913:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446921:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e374ef3/0x996d2fb20dc1e31d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.446940:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833939.446941:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833939.446943:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833939.446976:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787833939.446981:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000100:00100000:3.0:1787833939.447740:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406156672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787833939.447823:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833939.447875:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833939.447882:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406156800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787833939.447912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833939.447948:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406156672 00000100:00100000:3.0:1787833939.447953:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406156672 00000100:00100000:3.0:1787833939.448023:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406156800 00000100:00100000:3.0:1787833939.448027:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406156800 00000100:00100000:2.0:1787833939.448038:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787833939.448078:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1874679406156672:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787833939.448090:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787833939.448104:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1874679406156800:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:2.0:1787833939.448127:0:8431:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1787833939.448175:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.448202:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee55 expref: 12 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.448212:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787833939.448218:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833939.448223:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833939.448233:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787833939.448239:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787833939 00002000:00010000:3.0:1787833939.448242:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787833939.448245:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787833939 -> 1787833939 00002000:00010000:3.0:1787833939.448261:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787833939.448268:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee55 expref: 12 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.448289:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee55 expref: 12 pid: 8583 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.448304:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874679406156928:192.168.203.17@tcp:104: 00000004:00080000:0.0:1787833939.448628:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df503f40f00, transno 4294967308 00000004:00080000:0.0:1787833939.448641:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:0.0:1787833939.448669:0:3638:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8df504dbc780 x1874679406156544/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787833955 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787833939.448681:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df504dbc780/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787833939.448693:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406156544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787833939.448943:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787833939.449641:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3640:x1874679406156800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1530us (1716us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787833939.449653:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1787833939.449781:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df504c58f00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787833939.449793:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406156800:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787833939.450034:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450052:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450084:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450097:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccd800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833939.450102:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450110:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450125:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8df503f0ef00) 00010000:00010000:1.0:1787833939.450128:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833939.450133:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450139:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd800/0x996d2fb20dc1e01b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450165:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450171:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450177:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450182:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833939.450184:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450199:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450208:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8df502e69300) 00010000:00010000:1.0:1787833939.450210:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833939.450214:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450220:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1e0c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450239:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450245:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450252:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.450257:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504cccc00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833939.450260:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452100:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452129:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df608e13300) 00010000:00010000:1.0:1787833939.452132:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833939.452138:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452158:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504cccc00/0x996d2fb20dc1e141 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452182:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452189:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452194:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452199:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833939.452202:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452208:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452215:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df608e13300) 00010000:00010000:1.0:1787833939.452217:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833939.452220:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452224:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e164 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452240:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452246:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452256:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.452260:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833939.452263:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833939.452659:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.452843:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874679406156928:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833939.452881:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.453328:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381990656 00000100:00100000:0.0:1787833939.453352:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381990656 00000100:00100000:0.0:1787833939.453402:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:0.0:1787833939.453410:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+13:2400:x1874679381990656:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787833939.453880:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.453903:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833939.453906:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833939.453910:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.453917:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e236 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.453942:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.453948:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.453954:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.453959:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787833939.453962:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.453986:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.453995:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:1.0:1787833939.453997:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787833939.454000:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.454006:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677800/0x996d2fb20dc1e2f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833939.454612:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833939.454685:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381990784 00000100:00100000:1.0:1787833939.454692:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381990784 00010000:00010000:1.0:1787833939.454720:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee55 expref: 14 pid: 8583 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833939.454786:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 104 00000100:00100000:1.0:1787833939.454796:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+14:2400:x1874679381990784:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833939.454809:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833939.454822:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee55 expref: 14 pid: 8583 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.454836:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee55 expref: 14 pid: 8583 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.454861:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bab2ff9a/0x996d2fb20dc1e0d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee55 expref: 14 pid: 8583 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.454895:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833939.454899:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833939.454911:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.454921:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.454955:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833939.455022:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+13:2400:x1874679381990784:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 227us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.455029:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 104 00010000:00010000:1.0:1787833939.455065:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.455075:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.455084:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.455091:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.455107:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787833939.455403:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833939.455410:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.455417:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccce00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787833939.455421:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.455428:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.455439:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.455446:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c63f012a/0x996d2fb20dc1e324 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.455463:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833939.455465:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833939.455466:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787833939.460097:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1787833939.460116:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1787833939.460457:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381990656:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 7039us (7794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.460471:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:1.0:1787833939.461684:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406156672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13624us (13851us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787833939.461700:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:2.0:1787833939.463195:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df504c59a40/2, rc 0, transno 4294967323 00000100:00100000:2.0:1787833939.463221:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406156672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787833939.470211:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833939.470308:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381991040 00000100:00100000:1.0:1787833939.470323:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381991040 00000100:00100000:1.0:1787833939.470398:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 245 00000100:00100000:1.0:1787833939.470408:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+21:12471:x1874679381991040:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787833939.470457:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833939.470483:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1e308 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eeef expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.470503:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:1.0:1787833939.470508:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833939.470534:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.470547:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.470556:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833939.470670:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eb82196 reply state 00000000b99a5eeb transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.470682:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.470688:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:1.0:1787833939.470691:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787833939.470709:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833939.470848:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+22:12471:x1874679381991040:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 441us (651us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1787833939.470856:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 245 00000100:00100000:0.0:1787833939.476547:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833939.476893:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381991168 00000100:00100000:3.0:1787833939.476917:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381991168 00000100:00100000:3.0:1787833939.476995:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:3.0:1787833939.477006:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2401:x1874679381991168:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787833939.477332:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787833939.477336:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787833939 -> 1787833939 00002000:00010000:3.0:1787833939.477339:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787833938 00002000:00010000:3.0:1787833939.477342:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787833939 -> 1787833939 00002000:00010000:3.0:1787833939.477344:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787833939.477426:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2401:x1874679381991168:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 420us (886us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787833939.477435:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:3.0:1787833939.485688:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.486185:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381991424 00000100:00100000:0.0:1787833939.486198:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381991424 00000100:00100000:0.0:1787833939.486282:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 246 00000100:00100000:0.0:1787833939.486294:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+22:12471:x1874679381991424:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787833939.486363:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.486381:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee1 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.486401:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.486436:0:13407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee1 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.486450:0:13407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee1 expref: 22 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.486464:0:13407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406157056:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833939.486793:0:13407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833939.493578:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.493728:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381991552 00000100:00100000:2.0:1787833939.493739:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381991552 00010000:00010000:2.0:1787833939.493837:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee1 expref: 23 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.493873:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 105 00000100:00100000:2.0:1787833939.493882:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+23:2401:x1874679381991552:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833939.493899:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833939.493915:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee1 expref: 23 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.493930:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee1 expref: 23 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.493960:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:2.0:1787833939.493965:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.493976:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.493985:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.494006:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833939.494700:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccdc00/0x996d2fb20dc1e2ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee1 expref: 23 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.494725:0:13407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406157056:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833939.494791:0:13407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.494826:0:13407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.494833:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.494892:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.494900:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.494916:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.494923:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833939.494928:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.494935:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.494949:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:0.0:1787833939.494952:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787833939.494957:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.494964:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e332 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.495068:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+22:2401:x1874679381991552:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 1171us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.495080:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 105 00000100:00100000:0.0:1787833939.495358:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+21:12471:x1874679381991424:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 Request processed in 9066us (9684us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787833939.495373:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 246 00000100:00100000:3.0:1787833939.498961:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.499117:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381991680 00000100:00100000:0.0:1787833939.499130:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381991680 00000100:00100000:0.0:1787833939.499201:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:0.0:1787833939.499212:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c5ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2398:x1874679381991680:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787833939.499276:0:8583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.499303:0:8583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.499314:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833939.499319:0:8583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833939.499324:0:8583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.499369:0:8583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.499386:0:8583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 8 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.499403:0:8583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8583:1874679406157184:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833939.499513:0:8583:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833939.503520:0:8583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8583:1874679406157184:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833939.503585:0:8583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833939.509495:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.509851:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381991808 00000100:00100000:2.0:1787833939.509866:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381991808 00010000:00010000:2.0:1787833939.509935:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 9 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.509987:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 106 00000100:00100000:2.0:1787833939.509998:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+9:2401:x1874679381991808:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833939.510018:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833939.510047:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 9 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.510075:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 9 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.510108:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd52c206/0x996d2fb20dc1e316 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eefd expref: 9 pid: 8430 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.510145:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833939.510150:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833939.510158:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.510169:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.510209:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833939.510295:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2401:x1874679381991808:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 298us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.510323:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 106 00010000:00010000:0.0:1787833939.510460:0:8583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.510471:0:8583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.510501:0:8583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.510511:0:8583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.510520:0:8583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.510538:0:8583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787833939.510544:0:8583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.510555:0:8583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.510572:0:8583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.510590:0:8583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1e339 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.510664:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c5ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2398:x1874679381991680:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 11454us (11717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.510674:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:2.0:1787833939.516045:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833939.516240:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381992064 00000100:00100000:3.0:1787833939.516252:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381992064 00000100:00100000:3.0:1787833939.516328:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 247 00000100:00100000:3.0:1787833939.516360:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+21:12471:x1874679381992064:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787833939.516467:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.516488:0:9772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea9 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.516726:0:9772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.517135:0:9772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea9 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.517154:0:9772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea9 expref: 21 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.517171:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406157312:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787833939.517315:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833939.523148:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.523312:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406157312:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787833939.523345:0:9772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.524199:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381992192 00000100:00100000:0.0:1787833939.524213:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381992192 00010000:00010000:0.0:1787833939.524269:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea9 expref: 22 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.524781:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 107 00000100:00100000:0.0:1787833939.524796:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e166050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+22:2400:x1874679381992192:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833939.524817:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833939.524826:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea9 expref: 22 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.524843:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea9 expref: 22 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.524872:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e22f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eea9 expref: 22 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.524892:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:0.0:1787833939.524899:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eecc expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.524995:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.525004:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.525013:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.525104:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833939.525176:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e166050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+21:2400:x1874679381992192:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 385us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.525185:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 107 00010000:00010000:3.0:1787833939.526703:0:9772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.526722:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.527108:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.527128:0:9772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee8 expref: 21 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.527139:0:9772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.527186:0:9772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee8 expref: 21 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.527207:0:9772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee8 expref: 21 pid: 13407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833939.527251:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406157440:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787833939.527429:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833939.532452:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833939.532863:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381992320 00000100:00100000:2.0:1787833939.532875:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381992320 00010000:00010000:2.0:1787833939.532940:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee8 expref: 22 pid: 13407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.532993:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 108 00000100:00100000:2.0:1787833939.533003:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+22:2400:x1874679381992320:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833939.533023:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833939.533031:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee8 expref: 22 pid: 13407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.533046:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee8 expref: 22 pid: 13407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.533106:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:2.0:1787833939.533113:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.533124:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.533134:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.533156:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833939.533279:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+22:2400:x1874679381992320:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 276us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.533287:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 108 00010000:00010000:3.0:1787833939.534401:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e2fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eee8 expref: 21 pid: 13407 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833939.534430:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406157440:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787833939.534462:0:9772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.534474:0:9772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.534481:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833939.535006:0:9772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1787833939.535239:0:9772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1787833939.535277:0:9772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1787833939.535375:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9772:1874679406157568:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787833939.535461:0:9772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833939.535742:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833939.538151:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406157568 00000100:00100000:0.0:1787833939.538172:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406157568 00000100:00100000:0.0:1787833939.538259:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787833939.538271:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9772:x1874679406157568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787833939.538522:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9772:x1874679406157568:12345-0@lo:1000:mdt00_003.0 Request processed in 252us (3060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.538731:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787833939.539091:0:9772:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1787833939.539100:0:9772:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1787833939.539127:0:9772:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df504c58f00, transno 4294967322 00000100:00100000:2.0:1787833939.539188:0:9772:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8df504c59a40 x1874679406156672/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787833955 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833939.539204:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9772:1874679406157568:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787833939.539403:0:9772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1787833939.539496:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9772:1874679406157696:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787833939.539743:0:9772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833939.539819:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833939.539953:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406157696 00000100:00100000:1.0:1787833939.539962:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406157696 00000100:00100000:1.0:1787833939.540023:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787833939.540033:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9772:x1874679406157696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787833939.540234:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9772:x1874679406157696:12345-0@lo:1000:mdt00_003.0 Request processed in 202us (490us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787833939.540242:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787833939.540514:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9772:1874679406157696:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787833939.540580:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.540609:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.540618:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.540891:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833939.540897:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.540916:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.540937:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:2.0:1787833939.540940:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833939.540946:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.540953:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1e347 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.540986:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.540993:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.540999:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.541004:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833939.541014:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.541021:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.541030:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:2.0:1787833939.541032:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833939.541041:0:9772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eecc expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.541054:0:9772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eecc expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.541075:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eecc expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.541113:0:9772:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eecc expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.541129:0:9772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406157824:192.168.203.17@tcp:105: 00000100:00100000:2.0:1787833939.541217:0:9772:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b1a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833939.545096:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.545227:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381992448 00000100:00100000:0.0:1787833939.545239:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381992448 00000100:00100000:0.0:1787833939.545348:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:0.0:1787833939.545359:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+25:12470:x1874679381992448:12345-192.168.203.17@tcp:49:lfs.0 00000100:00100000:2.0:1787833939.545456:0:9772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9772:1874679406157824:192.168.203.17@tcp:105: 00010000:00010000:2.0:1787833939.545489:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.545550:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+25:12470:x1874679381992448:12345-192.168.203.17@tcp:49:lfs.0 Request processed in 193us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.545558:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00010000:00010000:2.0:1787833939.548627:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1e28a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548718:0:9772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548735:0:9772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548765:0:9772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548779:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548786:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548792:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548799:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccda00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833939.548804:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548812:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548826:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:2.0:1787833939.548829:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833939.548835:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548842:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccda00/0x996d2fb20dc1e34e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548861:0:9772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548867:0:9772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548873:0:9772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548879:0:9772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833939.548882:0:9772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548888:0:9772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548896:0:9772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:2.0:1787833939.548899:0:9772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787833939.548901:0:9772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.548913:0:9772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030200/0x996d2fb20dc1e340 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833939.549184:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+24:12471:x1874679381992064:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 32820us (33145us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787833939.549195:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 247 00000020:00080000:2.0:1787833939.549202:0:9772:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787833939.549207:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833939.549213:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833939.551307:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787833939.551332:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833939.554923:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.555618:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381992704 00000100:00100000:0.0:1787833939.555634:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381992704 00000100:00100000:0.0:1787833939.555721:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 248 00000100:00100000:0.0:1787833939.555734:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+24:12470:x1874679381992704:12345-192.168.203.17@tcp:58:lfs.0 00000040:00080000:0.0:1787833939.556004:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787833939.556132:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+24:12470:x1874679381992704:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 401us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.556141:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 248 00000100:00100000:0.0:1787833939.560489:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833939.561832:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381992960 00000100:00100000:1.0:1787833939.561851:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381992960 00000100:00100000:1.0:1787833939.561940:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1787833939.561952:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ecdcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+24:12471:x1874679381992960:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787833939.562306:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787833939.562354:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1787833939.562396:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.562416:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.562449:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.562460:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.562467:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.562473:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.562507:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787833939.562996:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ecdcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+26:12471:x1874679381992960:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 1041us (2516us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787833939.563008:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000020:00080000:1.0:1787833939.563016:0:6517:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787833939.563651:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833939.563681:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.563689:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787833939.563694:0:7455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.563704:0:7455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.563724:0:7455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:2.0:1787833939.563727:0:7455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787833939.563733:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.563739:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1e355 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.563779:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833939.563781:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833939.563782:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833939.606838:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833939.608100:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381993088 00000100:00100000:0.0:1787833939.608113:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381993088 00000100:00100000:0.0:1787833939.608185:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 249 00000100:00100000:0.0:1787833939.608196:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+26:12473:x1874679381993088:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787833939.608219:0:13407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833939.608240:0:13407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e35c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ef04 expref: -99 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608305:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608319:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608331:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608344:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608352:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608373:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608449:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608459:0:13407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eec5 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608467:0:13407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608497:0:13407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eec5 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.608511:0:13407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eec5 expref: 27 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.608524:0:13407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406157952:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787833939.608789:0:13407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833939.612220:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833939.612323:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381993344 00000100:00100000:3.0:1787833939.612335:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381993344 00000100:00100000:3.0:1787833939.612416:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:3.0:1787833939.612427:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+28:6172:x1874679381993344:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787833939.612790:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+29:6172:x1874679381993344:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 327us (547us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787833939.612820:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:2.0:1787833939.616407:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833939.616880:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381993472 00000100:00100000:3.0:1787833939.616894:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381993472 00010000:00010000:3.0:1787833939.616960:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eec5 expref: 29 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833939.617016:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 109 00000100:00100000:3.0:1787833939.617027:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+29:2401:x1874679381993472:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833939.617046:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833939.617053:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eec5 expref: 29 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.617078:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eec5 expref: 29 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.617108:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:3.0:1787833939.617114:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.617125:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.617134:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833939.617156:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833939.617227:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+29:2401:x1874679381993472:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 201us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833939.617256:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 109 00010000:00010000:0.0:1787833939.621853:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccc600/0x996d2fb20dc1e27c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eec5 expref: 28 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833939.621892:0:13407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13407:1874679406157952:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787833939.622176:0:13407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.622191:0:13407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.622223:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833939.622305:0:13407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787833939.622311:0:13407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833939.623503:0:13407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624273:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624288:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624295:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624303:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624310:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833939.624315:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624325:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624345:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833939.624349:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833939.624418:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624456:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1e363 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624479:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624486:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624491:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.624496:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833939.624500:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.629800:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.629830:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8df502e69a00) 00010000:00010000:0.0:1787833939.629835:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833939.629843:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.629853:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e36a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.630510:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e35c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef04 expref: 28 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.630562:0:13407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef04 expref: 27 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.630572:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:0.0:1787833939.630575:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833939.630579:0:13407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677e00, rc 0) 00000100:00100000:0.0:1787833939.630674:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12473:x1874679381993088:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 22478us (23842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.630686:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 249 00010000:00010000:0.0:1787833939.734017:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833939.800900:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833939.800930:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406158080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787833939.801025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833939.802278:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406158080 00000100:00100000:0.0:1787833939.802296:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406158080 00000100:00100000:0.0:1787833939.802381:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787833939.802393:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406158080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833939.802445:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787833939.802933:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406158080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 541us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.802942:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787833939.802968:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406158080:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787833940.567978:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833940.567987:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833940.568025:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787833940.568032:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833940.568168:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406158208:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787833940.568250:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504536780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833940.574599:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874679406158208:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787833940.583159:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833940.583229:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381993600 00000100:00100000:2.0:1787833940.583237:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381993600 00000100:00100000:2.0:1787833940.583287:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 250 00000100:00100000:2.0:1787833940.583295:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621339a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12484:x1874679381993600:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787833940.583327:0:9772:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787833940.583444:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621339a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12484:x1874679381993600:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 150us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833940.583462:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 250 00000100:00100000:0.0:1787833940.589489:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833940.589560:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381993856 00000100:00100000:3.0:1787833940.589570:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381993856 00000100:00100000:3.0:1787833940.589628:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 251 00000100:00100000:3.0:1787833940.589638:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+27:12484:x1874679381993856:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833940.589656:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833940.589674:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e378 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ef0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833940.589816:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e37f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833940.589832:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e37f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833940.589846:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e37f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833940.589859:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787833940.589968:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031600/0x996d2fb20dc1e378 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef0b expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833940.589998:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e37f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef0b expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833940.590143:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:3.0:1787833940.590147:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833940.590152:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031c00, rc 0) 00000100:00100000:3.0:1787833940.591112:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+29:12484:x1874679381993856:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1471us (1627us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787833940.591122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 251 00000100:00100000:3.0:1787833940.607703:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833940.607739:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833940.607993:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381993984 00000100:00100000:1.0:1787833940.608002:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381993984 00000100:00100000:1.0:1787833940.608121:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:1.0:1787833940.608132:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+29:2401:x1874679381993984:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833940.608147:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833940.608171:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1e37f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef0b expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833940.608186:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833940.608197:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833940.608243:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+28:2401:x1874679381993984:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 114us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833940.608251:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:0.0:1787833940.608534:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381994240 00000100:00100000:0.0:1787833940.608544:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381994240 00000100:00100000:0.0:1787833940.608584:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 252 00000100:00100000:0.0:1787833940.608591:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+28:12484:x1874679381994240:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787833940.608650:0:13407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833940.608665:0:13407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833940.608674:0:13407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833940.608845:0:13407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833940.608854:0:13407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833940.608860:0:13407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833940.608867:0:13407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787833940.608871:0:13407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833940.608878:0:13407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833940.608888:0:13407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:0.0:1787833940.608891:0:13407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787833940.608907:0:13407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833940.608925:0:13407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1e38d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833940.609020:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+29:12484:x1874679381994240:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 428us (1279us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787833940.609028:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 252 00000040:00080000:1.0:1787833940.609500:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833940.609505:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833940.610073:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787833940.610082:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787833940.614357:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833940.617062:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381994496 00000100:00100000:1.0:1787833940.617077:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381994496 00000100:00100000:1.0:1787833940.617152:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:3.0:1787833940.617156:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787833940.617162:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+29:12484:x1874679381994496:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787833940.617166:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1787833940.617380:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+30:12484:x1874679381994496:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 219us (3031us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787833940.617388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000040:00080000:0.0:1787833940.669998:0:14758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833940.670066:0:14758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787833940.670107:0:14758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787833940.670115:0:14758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787833940.759183:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833940.810230:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833940.810338:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381994752 00000100:00100000:1.0:1787833940.810347:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381994752 00000100:00100000:1.0:1787833940.810404:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 253 00000100:00100000:1.0:1787833940.810414:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+30:12497:x1874679381994752:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787833940.810437:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833940.810457:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e394 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ef12 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833940.810561:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e39b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833940.810576:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e39b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833940.810595:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e39b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833940.810607:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787833940.810707:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1e394 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef12 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833940.810725:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e39b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef12 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833940.810733:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:1.0:1787833940.810736:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787833940.810740:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723a00, rc 0) 00000100:00100000:1.0:1787833940.810816:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+32:12497:x1874679381994752:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 403us (594us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787833940.810823:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 253 00000100:00100000:1.0:1787833940.816021:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833940.816167:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381994880 00000100:00100000:2.0:1787833940.816176:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381994880 00000100:00100000:2.0:1787833940.816234:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 254 00000100:00100000:2.0:1787833940.816244:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+32:12497:x1874679381994880:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:2.0:1787833940.816310:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833940.816328:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833940.816340:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833940.816374:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833940.816381:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833940.816388:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833940.816394:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccd400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833940.816398:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833940.816405:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833940.816416:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:2.0:1787833940.816426:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833940.816431:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833940.816437:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504ccd400/0x996d2fb20dc1e3a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833940.816514:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+32:12497:x1874679381994880:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 271us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833940.816522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 254 00000100:00100000:0.0:1787833940.941042:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833940.942011:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381995008 00000100:00100000:3.0:1787833940.942022:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381995008 00000100:00100000:3.0:1787833940.942111:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:3.0:1787833940.942123:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621338f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2398:x1874679381995008:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:3.0:1787833940.942140:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833940.942162:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1e3b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ef19 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833940.942188:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a902e53, atime: 0x6a902e52, ctime: 0x6a902e53, blocks: 0x8 00010000:00010000:3.0:1787833940.942218:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1787833940.942224:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833940.942235:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1e3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef19 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833940.942261:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1e3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef19 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833940.942272:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031600, rc 0) 00000100:00100000:3.0:1787833940.942331:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621338f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2398:x1874679381995008:12345-192.168.203.17@tcp:101:cat.0 Request processed in 211us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833940.942338:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00080000:2.0:1787833940.943566:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833940.949029:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833940.949435:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381995136 00000100:00100000:3.0:1787833940.949458:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381995136 00002000:00100000:3.0:1787833940.949509:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8df504600780 x1874679381995136/t0(0) o3->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:746/0 lens 488/0 e 0 to 0 dl 1787833951 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833940.949521:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504600780 with x1874679381995136 ext(0->4095) 00002000:00010000:3.0:1787833940.949526:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504600780 00000100:00100000:3.0:1787833940.949565:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:3.0:1787833940.949576:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2399:x1874679381995136:12345-192.168.203.17@tcp:3:cat.0 00000100:00100000:3.0:1787833940.949727:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2399:x1874679381995136:12345-192.168.203.17@tcp:3:cat.0 Request processed in 152us (706us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787833940.949734:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00002000:00100000:3.0:1787833940.949741:0:8435:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8df504600780 x1874679381995136/t0(0) o3->a4724ace-a769-4adb-acca-a2bfbc389c92@192.168.203.17@tcp:746/0 lens 488/4536 e 0 to 0 dl 1787833951 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833940.949786:0:8435:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8df504600780 with x1874679381995136 ext(0->4095) 00002000:00010000:3.0:1787833940.949790:0:8435:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df504600780 00000100:00100000:0.0:1787833941.334011:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787833941.334036:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406158464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833941.334110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833941.334184:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406158336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833941.334210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833941.334284:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406158464 00000100:00100000:1.0:1787833941.334291:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406158464 00000100:00100000:1.0:1787833941.334350:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406158336 00000100:00100000:1.0:1787833941.334353:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406158336 00000100:00100000:3.0:1787833941.334363:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787833941.334386:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406158464:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787833941.334399:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787833941.334413:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787833941.334439:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787833941.334446:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874679406158336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833941.334457:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787833941.334468:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406158464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833941.334476:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787833941.334482:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874679406158336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833941.334496:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787833941.334579:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406158464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833941.334593:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406158336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787833941.781985:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833942.071320:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833942.071355:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833942.071459:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833942.071485:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833942.071508:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833942.071526:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833942.071550:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833942.071584:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381995520 00000100:00100000:0.0:1787833942.071598:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381995520 00000100:00100000:0.0:1787833942.071664:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381996032 00000100:00100000:0.0:1787833942.071668:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381996032 00000100:00100000:0.0:1787833942.071681:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381995392 00000100:00100000:0.0:1787833942.071683:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381995392 00000100:00100000:0.0:1787833942.071695:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381995904 00000100:00100000:0.0:1787833942.071697:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381995904 00000100:00100000:0.0:1787833942.071715:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 348 00000100:00100000:3.0:1787833942.071725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381995264 00000100:00100000:3.0:1787833942.071732:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381995264 00000100:00100000:3.0:1787833942.071784:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 395 00000100:00100000:3.0:1787833942.071792:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381995264:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833942.071856:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2400:x1874679381995264:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 65us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833942.071863:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 395 00000100:00100000:0.0:1787833942.072346:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381995520:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833942.072455:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381995520:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 731us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.072463:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 348 00000100:00100000:0.0:1787833942.072482:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 349 00000100:00100000:0.0:1787833942.072489:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381996032:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833942.072515:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381996032:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.072520:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 349 00000100:00100000:0.0:1787833942.072532:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 350 00000100:00100000:0.0:1787833942.072538:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+32:2400:x1874679381995392:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833942.072559:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+32:2400:x1874679381995392:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 22us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.072565:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 350 00000100:00100000:0.0:1787833942.072576:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 351 00000100:00100000:0.0:1787833942.072581:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381995904:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833942.072598:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2400:x1874679381995904:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 18us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.072663:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 351 00000100:00100000:0.0:1787833942.072691:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381995776 00000100:00100000:0.0:1787833942.072696:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381995776 00000100:00100000:0.0:1787833942.072721:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381995648 00000100:00100000:0.0:1787833942.072724:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381995648 00000100:00100000:0.0:1787833942.072882:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:0.0:1787833942.072891:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381995776:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833942.072989:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2400:x1874679381995776:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 99us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.072996:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:0.0:1787833942.073009:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:0.0:1787833942.073015:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381995648:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833942.073320:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+8:2400:x1874679381995648:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 303us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.073328:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00080000:0.0:1787833942.073351:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833942.073356:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833942.073358:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833942.073360:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787833942.805955:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833943.381973:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833943.381997:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406158592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787833943.382074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833943.382144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406158592 00000100:00100000:2.0:1787833943.382152:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406158592 00000100:00100000:2.0:1787833943.382199:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787833943.382208:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406158592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787833943.382240:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787833943.382288:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406158592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.382296:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787833943.382341:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406158592:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787833943.829930:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833943.894655:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833943.894679:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406158720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833943.894747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833943.894834:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406158720 00000100:00100000:1.0:1787833943.894841:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406158720 00000100:00100000:1.0:1787833943.894891:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787833943.894900:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406158720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833943.894930:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833943.894974:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406158720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833943.894981:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1787833943.895002:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787833943.895047:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406158720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833943.896897:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833943.896915:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406158848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833943.896973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833943.897065:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406158848 00000100:00100000:3.0:1787833943.897072:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406158848 00000100:00100000:3.0:1787833943.897136:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787833943.897145:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406158848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833943.897165:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833943.897206:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406158848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833943.897214:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787833943.897256:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406158848:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787833943.897521:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787833943.901691:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406159104:0@lo:400:kworker.0 00000100:00100000:1.0:1787833943.901782:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833943.901824:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504602d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406159616:0@lo:400:kworker.0 00000100:00100000:1.0:1787833943.901848:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833943.901870:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406160128:0@lo:400:kworker.0 00000100:00100000:1.0:1787833943.901891:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833943.901915:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787833943.901920:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504602580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406159232:0@lo:400:kworker.0 00000100:00100000:1.0:1787833943.901945:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833943.901962:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406159744:0@lo:400:kworker.0 00000100:00100000:1.0:1787833943.902004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833943.902049:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406159104 00000100:00100000:2.0:1787833943.902137:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406158976:0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833943.902196:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406159488:0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902217:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833943.902229:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406160000:0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833943.902263:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787833943.902270:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406159360:0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833943.902301:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406159872:0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833943.902345:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406158976 00000100:00100000:2.0:1787833943.902352:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406158976 00000100:00100000:2.0:1787833943.902394:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787833943.902401:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406158976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902448:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3639:x1874679406158976:12345-0@lo:400:kworker.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.902455:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787833943.902486:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406159616 00000100:00100000:2.0:1787833943.902489:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406159616 00000100:00100000:2.0:1787833943.902516:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406160128 00000100:00100000:2.0:1787833943.902519:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406160128 00000100:00100000:2.0:1787833943.902543:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406159488 00000100:00100000:2.0:1787833943.902545:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406159488 00000100:00100000:2.0:1787833943.902557:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406160000 00000100:00100000:2.0:1787833943.902559:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406160000 00000100:00100000:2.0:1787833943.902568:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406159360 00000100:00100000:2.0:1787833943.902571:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406159360 00000100:00100000:2.0:1787833943.902582:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787833943.902587:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406159616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902625:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406159616:12345-0@lo:400:kworker.0 Request processed in 37us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.902631:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787833943.902644:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787833943.902649:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406160128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902675:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406160128:12345-0@lo:400:kworker.0 Request processed in 26us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.902681:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787833943.902692:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787833943.902698:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406159488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902723:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406159488:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.902728:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787833943.902739:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787833943.902745:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406160000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902795:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406160000:12345-0@lo:400:kworker.0 Request processed in 51us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.902802:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787833943.902813:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787833943.902826:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406159360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902854:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406159360:12345-0@lo:400:kworker.0 Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.902859:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787833943.902877:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406159744 00000100:00100000:2.0:1787833943.902880:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406159744 00000100:00100000:2.0:1787833943.902904:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406159872 00000100:00100000:2.0:1787833943.902907:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406159872 00000100:00100000:2.0:1787833943.902925:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787833943.902931:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406159744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.902960:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406159744:12345-0@lo:400:kworker.0 Request processed in 29us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.902965:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787833943.902976:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787833943.902981:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1874679406159872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.903008:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1874679406159872:12345-0@lo:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.903013:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787833943.903075:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406159744:0@lo:400:kworker.0 00010000:00080000:2.0:1787833943.903089:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504602d00 x1874679406159616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833943.903099:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504602d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406159616:0@lo:400:kworker.0 00010000:00080000:2.0:1787833943.903108:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621292940 x1874679406160128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833943.903116:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406160128:0@lo:400:kworker.0 00000100:00080000:2.0:1787833943.903157:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833943.903161:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787833943.903163:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787833943.903180:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406159360:0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.903190:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406159872:0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.903197:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406158976:0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.903206:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406159488:0@lo:400:kworker.0 00000100:00100000:2.0:1787833943.903214:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406160000:0@lo:400:kworker.0 00000100:00100000:1.0:1787833943.903373:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406159104 00000100:00100000:1.0:1787833943.903411:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787833943.903418:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406159104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833943.903465:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406159104:12345-0@lo:400:kworker.0 Request processed in 47us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833943.903471:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787833943.903494:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406159232 00000100:00100000:1.0:1787833943.903499:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406159232 00000100:00100000:1.0:1787833943.903524:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787833943.903530:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406159232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833943.903561:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406159232:12345-0@lo:400:kworker.0 Request processed in 31us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833943.903566:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787833943.903638:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504602580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406159232:0@lo:400:kworker.0 00000100:00100000:0.0:1787833943.903649:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406159104:0@lo:400:kworker.0 00010000:00010000:2.0:1787833944.856122:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787833944.922401:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1787833944.922418:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:2.0:1787833944.929282:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833944.929306:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406160256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787833944.929380:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833944.929446:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406160256 00000100:00100000:2.0:1787833944.929452:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406160256 00000100:00100000:2.0:1787833944.929499:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787833944.929508:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620575050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406160256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787833944.929541:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787833944.929587:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620575050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406160256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833944.929594:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787833944.929957:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406160256:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1787833944.932386:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1787833944.932424:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df63b1a8540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787833944.932429:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df618629400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df63b1a8480 00000020:00080000:1.0:1787833944.932433:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df618629500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df601285800 00000020:00080000:1.0:1787833944.932456:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1787833944.933196:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833944.933210:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833944.933233:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833944.933239:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787833944.933243:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833944.933251:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833944.933268:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8df608e13b00) 00010000:00010000:2.0:1787833944.933271:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833944.933276:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833944.933282:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1e32b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833944.934114:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787833944.934187:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1787833944.938954:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000040:00080000:2.0:1787833945.559535:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787833945.632289:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833945.632388:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381996160 00000100:00100000:0.0:1787833945.632398:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381996160 00000100:00100000:0.0:1787833945.632493:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 255 00000100:00100000:0.0:1787833945.632503:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+18:12151:x1874679381996160:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787833945.632625:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a4724ace-a769-4adb-acca-a2bfbc389c92+18:12151:x1874679381996160:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 Request processed in 123us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833945.632633:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 255 00000100:00080000:2.0:1787833945.634998:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833945.640675:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833945.641225:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381996288 00000100:00100000:0.0:1787833945.641236:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381996288 00000100:00100000:0.0:1787833945.641319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 256 00000100:00100000:0.0:1787833945.641329:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:12151:x1874679381996288:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1787833945.641510:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833945.641615:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:12151:x1874679381996288:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 Request processed in 287us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833945.641624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 256 00000100:00100000:3.0:1787833945.652502:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833945.652805:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381996544 00000100:00100000:0.0:1787833945.652815:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381996544 00000100:00100000:0.0:1787833945.652877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:0.0:1787833945.652887:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+18:12151:x1874679381996544:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787833945.653142:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+19:12151:x1874679381996544:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 257us (649us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787833945.653150:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00000040:00080000:1.0:1787833945.749953:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833945.749963:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833945.749986:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787833945.749996:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787833945.878199:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833945.884196:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833945.884614:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381996672 00000100:00100000:0.0:1787833945.884624:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381996672 00000100:00080000:2.0:1787833945.884776:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833945.884892:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 257 00000100:00100000:0.0:1787833945.884903:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:12954:x1874679381996672:12345-192.168.203.17@tcp:101:lsof.0 00010000:00010000:0.0:1787833945.884923:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833945.884955:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e3b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ef20 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833945.885028:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e3be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833945.885042:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e3be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833945.885052:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e3be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833945.885099:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787833945.885103:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787833945.885125:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e3be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833945.885149:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1e3b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef20 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833945.885167:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e3be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef20 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833945.885175:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f0e100) 00010000:00010000:0.0:1787833945.885179:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833945.885182:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677200, rc 0) 00000100:00100000:0.0:1787833945.885258:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+6:12954:x1874679381996672:12345-192.168.203.17@tcp:101:lsof.0 Request processed in 356us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833945.885266:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 257 00000100:00100000:2.0:1787833946.454125:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833946.454254:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504570f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406160512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833946.454319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833946.454431:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406160384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833946.454455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833946.455847:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406160512 00000100:00100000:1.0:1787833946.455872:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406160512 00000100:00100000:0.0:1787833946.456128:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406160384 00000100:00100000:0.0:1787833946.456139:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406160384 00000100:00100000:3.0:1787833946.456193:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787833946.456204:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406160512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833946.456236:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787833946.456299:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406160512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833946.456306:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787833946.456354:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787833946.456360:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df504c59a40, transno 4294967323 00000004:00080000:3.0:1787833946.456371:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1787833946.456408:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504570f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406160512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787833946.457071:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833946.457211:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787833946.457221:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406160384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787833946.457236:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787833946.457287:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406160384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833946.457294:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787833946.457373:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406160384:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787833946.903475:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833947.189092:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833947.189305:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381996928 00000100:00100000:0.0:1787833947.189315:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381996928 00000100:00080000:2.0:1787833947.189545:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833947.189709:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 358 00000100:00100000:0.0:1787833947.189723:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+19:2400:x1874679381996928:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833947.189865:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+19:2400:x1874679381996928:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 145us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833947.191360:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833947.191410:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833947.191436:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833947.191455:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833947.191479:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381997056 00000100:00100000:3.0:1787833947.191486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381997056 00000100:00100000:2.0:1787833947.191981:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381996800 00000100:00100000:2.0:1787833947.191987:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381996800 00000100:00100000:2.0:1787833947.192033:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 397 00000100:00100000:2.0:1787833947.192042:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381996800:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833947.192111:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381996800:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 71us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833947.192117:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 397 00000100:00100000:2.0:1787833947.192145:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381997312 00000100:00100000:2.0:1787833947.192148:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381997312 00000100:00100000:2.0:1787833947.192175:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:2.0:1787833947.192181:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381997312:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833947.192208:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381997312:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833947.192214:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00080000:2.0:1787833947.192332:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833947.192336:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787833947.192358:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381997568 00000100:00100000:2.0:1787833947.192362:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381997568 00000100:00080000:1.0:1787833947.196374:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787833947.196784:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 358 00000100:00100000:3.0:1787833947.198215:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 359 00000100:00100000:3.0:1787833947.198234:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381997056:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833947.198317:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2401:x1874679381997056:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 91us (6906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833947.198324:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 359 00000100:00100000:3.0:1787833947.198405:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833947.198513:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833947.198535:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381997184 00000100:00100000:3.0:1787833947.198680:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381997184 00000100:00100000:3.0:1787833947.198724:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:3.0:1787833947.198742:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381997184:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833947.198844:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2400:x1874679381997184:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 70us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833947.198853:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:3.0:1787833947.198876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381997440 00000100:00100000:3.0:1787833947.198880:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381997440 00000100:00100000:3.0:1787833947.198907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 360 00000100:00100000:3.0:1787833947.198914:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2400:x1874679381997440:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833947.198942:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2400:x1874679381997440:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833947.198949:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 360 00000100:00100000:2.0:1787833947.199109:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 361 00000100:00100000:2.0:1787833947.199119:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381997568:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787833947.199152:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2401:x1874679381997568:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (7697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833947.199159:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 361 00000100:00080000:1.0:1787833947.199709:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833947.199716:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787833947.926175:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833948.501965:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406160640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787833948.502051:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833948.502167:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406160640 00000100:00100000:1.0:1787833948.502174:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406160640 00000100:00100000:1.0:1787833948.502222:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787833948.502230:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504571a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406160640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787833948.502260:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787833948.502833:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504571a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406160640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 601us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833948.502850:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787833948.503869:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406160640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787833948.949900:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833949.014001:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833949.014028:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406160768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833949.014096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833949.014217:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406160768 00000100:00100000:1.0:1787833949.014225:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406160768 00000100:00100000:1.0:1787833949.014310:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787833949.014322:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504572940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406160768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833949.014354:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833949.014406:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504572940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406160768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.014414:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787833949.014462:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406160768:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787833949.014609:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833949.015102:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406161280:0@lo:400:kworker.0 00000100:00100000:3.0:1787833949.015141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833949.015171:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406161792:0@lo:400:kworker.0 00000100:00100000:2.0:1787833949.015196:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406161152:0@lo:400:kworker.0 00000100:00100000:3.0:1787833949.015203:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833949.015245:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406161792 00000100:00100000:2.0:1787833949.015247:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833949.015251:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406161792 00000100:00100000:2.0:1787833949.015285:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406161664:0@lo:400:kworker.0 00000100:00100000:2.0:1787833949.015310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833949.015328:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406162176:0@lo:400:kworker.0 00000100:00100000:2.0:1787833949.015351:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833949.015375:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833949.015383:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504572d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833949.015405:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406161664 00000100:00100000:2.0:1787833949.015410:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833949.015412:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406161664 00000100:00100000:0.0:1787833949.015457:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406162176 00000100:00100000:0.0:1787833949.015460:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406162176 00000100:00100000:2.0:1787833949.015479:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787833949.015489:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406161664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833949.015532:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406161664:12345-0@lo:400:kworker.0 Request processed in 45us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.015556:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406160896:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.015588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833949.015611:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406161408:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.015639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833949.015653:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406161920:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.015670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833949.015687:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787833949.015692:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504c5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406161024:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.015713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833949.015730:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406161536:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.015767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833949.015784:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406162048:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.015804:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833949.015826:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406160896 00000100:00100000:1.0:1787833949.015829:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406160896 00000100:00100000:1.0:1787833949.015856:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787833949.015862:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406160896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.015896:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406160896:12345-0@lo:400:kworker.0 Request processed in 35us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.015903:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787833949.015930:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406161280 00000100:00100000:1.0:1787833949.015933:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406161280 00000100:00100000:1.0:1787833949.015951:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406161408 00000100:00100000:1.0:1787833949.015954:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406161408 00000100:00100000:1.0:1787833949.015966:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406161920 00000100:00100000:1.0:1787833949.015968:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406161920 00000100:00100000:1.0:1787833949.015980:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406161024 00000100:00100000:1.0:1787833949.015982:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406161024 00000100:00100000:1.0:1787833949.016002:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406161536 00000100:00100000:1.0:1787833949.016005:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406161536 00000100:00100000:1.0:1787833949.016019:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406162048 00000100:00100000:1.0:1787833949.016028:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406162048 00000100:00100000:1.0:1787833949.016047:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787833949.016051:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406161280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016085:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406161280:12345-0@lo:400:kworker.0 Request processed in 33us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.016090:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787833949.016101:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787833949.016106:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406161408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016129:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406161408:12345-0@lo:400:kworker.0 Request processed in 23us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.016134:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787833949.016144:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787833949.016149:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406161920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016170:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406161920:12345-0@lo:400:kworker.0 Request processed in 21us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.016177:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787833949.016187:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787833949.016192:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406161024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016215:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406161024:12345-0@lo:400:kworker.0 Request processed in 23us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.016220:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787833949.016230:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787833949.016236:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406161536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016280:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406161536:12345-0@lo:400:kworker.0 Request processed in 45us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.016293:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787833949.016304:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787833949.016309:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406162048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016336:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406162048:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.016341:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787833949.016383:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406161024:0@lo:400:kworker.0 00010000:00080000:1.0:1787833949.016394:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504dbd680 x1874679406161536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833949.016403:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406161536:0@lo:400:kworker.0 00010000:00080000:1.0:1787833949.016411:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504dbf480 x1874679406162048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833949.016419:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406162048:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016433:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406160896:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016442:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406161408:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016450:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406161920:0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016503:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406161152 00000100:00100000:1.0:1787833949.016507:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406161152 00000100:00100000:1.0:1787833949.016531:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787833949.016537:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406161152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833949.016569:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406161152:12345-0@lo:400:kworker.0 Request processed in 32us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833949.016583:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1787833949.016598:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787833949.016601:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833949.016604:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833949.016606:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833949.016641:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406161280:0@lo:400:kworker.0 00000100:00100000:0.0:1787833949.017903:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787833949.017921:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406162176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833949.017986:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406162176:12345-0@lo:400:kworker.0 Request processed in 74us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833949.018004:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787833949.018056:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406162304 00000100:00100000:0.0:1787833949.018062:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406162304 00000100:00100000:0.0:1787833949.018100:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787833949.018108:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406162304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833949.018123:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787833949.018154:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406162304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833949.018160:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787833949.018211:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1787833949.018218:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df504dbc780, transno 4294967311 00000100:00100000:0.0:1787833949.018236:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504572d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833949.018251:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504c5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406161152:0@lo:400:kworker.0 00000100:00100000:0.0:1787833949.018338:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406161664:0@lo:400:kworker.0 00000100:00100000:0.0:1787833949.018347:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406162176:0@lo:400:kworker.0 00000100:00100000:3.0:1787833949.018688:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787833949.018699:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406161792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833949.018742:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406161792:12345-0@lo:400:kworker.0 Request processed in 47us (3544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833949.018764:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787833949.019104:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787833949.019201:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406161792:0@lo:400:kworker.0 00000001:02000400:0.0:1787833949.452968:0:14955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:32:28 (1787833948) 00010000:00010000:0.0:1787833949.975633:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833950.037875:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833950.037898:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406162432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787833950.037966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833950.038039:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406162432 00000100:00100000:2.0:1787833950.038046:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406162432 00000100:00100000:2.0:1787833950.038095:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787833950.038104:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406162432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787833950.038137:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787833950.038185:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406162432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833950.043792:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787833950.043873:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406162432:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787833950.999473:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787833951.070905:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1787833951.070920:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787833951.070944:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787833951.070956:0:6546:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787833951.574566:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833951.574591:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406162560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833951.574662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833951.574817:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406162560 00000100:00100000:1.0:1787833951.574833:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406162560 00000100:00100000:1.0:1787833951.574898:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787833951.574908:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406162560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833951.574937:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787833951.575000:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406162560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833951.575008:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787833951.575097:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406162560:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787833951.575121:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833951.576101:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833951.576116:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406162688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833951.576164:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833951.576257:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406162688 00000100:00100000:3.0:1787833951.576263:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406162688 00000100:00100000:3.0:1787833951.576335:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787833951.576343:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406162688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833951.576360:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787833951.576401:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406162688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833951.576409:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787833951.576444:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406162688:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787833951.576561:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787833952.021914:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833952.308956:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.309014:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.309043:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.309060:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.309079:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.309094:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.309113:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.309136:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381997952 00000100:00100000:3.0:1787833952.309144:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381997952 00000100:00100000:3.0:1787833952.309194:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381998464 00000100:00100000:3.0:1787833952.309197:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381998464 00000100:00100000:3.0:1787833952.309212:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381997824 00000100:00100000:3.0:1787833952.309215:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381997824 00000100:00100000:3.0:1787833952.309226:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381998336 00000100:00100000:3.0:1787833952.309228:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381998336 00000100:00100000:3.0:1787833952.309245:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 368 00000100:00100000:3.0:1787833952.309254:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381997952:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833952.309327:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381997952:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 73us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.309335:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 368 00000100:00100000:3.0:1787833952.309371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 369 00000100:00100000:3.0:1787833952.309378:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381998464:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833952.309404:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2399:x1874679381998464:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.309410:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 369 00000100:00100000:3.0:1787833952.309421:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 370 00000100:00100000:3.0:1787833952.309427:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+18:2399:x1874679381997824:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833952.309451:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+18:2399:x1874679381997824:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 25us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.309471:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 370 00000100:00100000:3.0:1787833952.309484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 371 00000100:00100000:3.0:1787833952.309490:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2399:x1874679381998336:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833952.309513:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2399:x1874679381998336:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.309519:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 371 00000100:00100000:3.0:1787833952.309550:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381998208 00000100:00100000:3.0:1787833952.309553:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381998208 00000100:00100000:3.0:1787833952.309578:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381998080 00000100:00100000:3.0:1787833952.309580:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381998080 00000100:00100000:3.0:1787833952.309597:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:3.0:1787833952.309603:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381998208:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833952.309631:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2399:x1874679381998208:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.309637:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:3.0:1787833952.309656:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 143 00000100:00100000:3.0:1787833952.309663:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2399:x1874679381998080:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787833952.309689:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2399:x1874679381998080:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.309695:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 143 00000100:00100000:0.0:1787833952.310386:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381997696 00000100:00100000:0.0:1787833952.310394:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381997696 00000100:00100000:0.0:1787833952.310437:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 399 00000100:00100000:0.0:1787833952.310445:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381997696:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787833952.310494:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2399:x1874679381997696:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 50us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833952.310502:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 399 00000100:00080000:0.0:1787833952.310551:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833952.310556:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833952.310558:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833952.310561:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787833952.793162:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833952.793276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381998720 00000100:00100000:0.0:1787833952.793286:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381998720 00000100:00100000:0.0:1787833952.793349:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:0.0:1787833952.793360:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+18:13177:x1874679381998720:12345-192.168.203.17@tcp:35:umount.0 00000100:00100000:0.0:1787833952.793623:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+19:13177:x1874679381998720:12345-192.168.203.17@tcp:35:umount.0 Request processed in 264us (470us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787833952.793631:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:3.0:1787833952.797591:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833952.797691:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381998976 00000100:00100000:0.0:1787833952.797702:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381998976 00000100:00100000:0.0:1787833952.797790:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:0.0:1787833952.797801:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+19:13177:x1874679381998976:12345-192.168.203.17@tcp:35:umount.0 00000100:00100000:0.0:1787833952.798118:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+20:13177:x1874679381998976:12345-192.168.203.17@tcp:35:umount.0 Request processed in 318us (535us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787833952.798141:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:3.0:1787833952.802612:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833952.802954:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381999232 00000100:00100000:1.0:1787833952.802977:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381999232 00000100:00100000:1.0:1787833952.803041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:1.0:1787833952.803053:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60ecdfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+20:13177:x1874679381999232:12345-192.168.203.17@tcp:35:umount.0 00000100:00100000:1.0:1787833952.803298:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60ecdfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+21:13177:x1874679381999232:12345-192.168.203.17@tcp:35:umount.0 Request processed in 247us (696us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787833952.803306:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:2.0:1787833952.805324:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833952.816056:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381999488 00000100:00100000:0.0:1787833952.816071:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381999488 00000100:00100000:0.0:1787833952.816146:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:0.0:1787833952.816157:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+21:13177:x1874679381999488:12345-192.168.203.17@tcp:35:umount.0 00000100:00100000:0.0:1787833952.816453:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a4724ace-a769-4adb-acca-a2bfbc389c92+22:13177:x1874679381999488:12345-192.168.203.17@tcp:35:umount.0 Request processed in 297us (11136us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787833952.816462:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:3.0:1787833952.821389:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.821436:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.821464:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833952.821532:0:8583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381999616 00000100:00100000:0.0:1787833952.821541:0:8583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381999616 00000100:00100000:3.0:1787833952.821552:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787833952.821600:0:8583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:0.0:1787833952.821610:0:8583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2397:x1874679381999616:12345-192.168.203.17@tcp:9:umount.0 00000020:00000080:0.0:1787833952.821637:0:8583:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d6b3 00000100:00080000:0.0:1787833952.821647:0:8583:0:(import.c:65:import_set_state_nolock()) ffff8df5047af800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787833952.821686:0:8583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787833952.821863:0:8583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+2:2397:x1874679381999616:12345-192.168.203.17@tcp:9:umount.0 Request processed in 254us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833952.821871:0:8583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 80 00010000:00010000:0.0:1787833952.821891:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833952.826724:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381999872 00000100:00100000:0.0:1787833952.826737:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381999872 00000100:00100000:0.0:1787833952.826825:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679381999744 00000100:00100000:0.0:1787833952.826829:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679381999744 00000100:00100000:0.0:1787833952.826841:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382000000 00000100:00100000:0.0:1787833952.826843:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382000000 00000100:00100000:0.0:1787833952.826864:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:0.0:1787833952.826873:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+15:2401:x1874679381999872:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833952.826904:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833952.826924:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b247800/0x996d2fb20dc1d2d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea34 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.826941:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833952.827011:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+14:2401:x1874679381999872:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 139us (5573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833952.827018:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:0.0:1787833952.827034:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:0.0:1787833952.827040:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+13:2401:x1874679381999744:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833952.827049:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833952.827057:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1d317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea73 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.827066:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833952.827081:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:2401:x1874679381999744:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 42us (5617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833952.827087:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:0.0:1787833952.827097:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787833952.827103:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:2401:x1874679382000000:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833952.827110:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833952.827118:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1d5b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb4c expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.827125:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833952.827139:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2401:x1874679382000000:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 36us (5589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833952.827150:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787833952.829036:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833952.829110:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382000384 00000100:00100000:3.0:1787833952.829118:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382000384 00000100:00100000:3.0:1787833952.829169:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 81 00000100:00100000:3.0:1787833952.829178:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504573c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+7:2397:x1874679382000384:12345-192.168.203.17@tcp:9:umount.0 00000020:00000080:3.0:1787833952.829205:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d922 00000020:00010000:3.0:1787833952.829214:0:8431:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df50474a000: total 0 00000100:00080000:3.0:1787833952.829219:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8df50474d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787833952.829606:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787833952.829743:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504573c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2397:x1874679382000384:12345-192.168.203.17@tcp:9:umount.0 Request processed in 565us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.829780:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 81 00000020:00010000:0.0:1787833952.830287:0:7455:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df50474a000: total 0 00010000:00010000:0.0:1787833952.830327:0:7455:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df50474a000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787833952.830381:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1e3b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef19 expref: 4 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.830412:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c84445ef/0x996d2fb20dc1dce1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed36 expref: 3 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.830425:0:7455:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df50474a000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787833952.830436:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833952.830438:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833952.830439:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833952.846592:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833952.846669:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382001408 00000100:00100000:1.0:1787833952.846684:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382001408 00000100:00100000:1.0:1787833952.846793:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 258 00000100:00100000:1.0:1787833952.846814:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+22:2397:x1874679382001408:12345-192.168.203.17@tcp:39:umount.0 00000020:00000080:1.0:1787833952.846859:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d2e6 00000020:00010000:1.0:1787833952.846875:0:6513:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df503f96800: total 0 00000100:00080000:1.0:1787833952.846880:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8df503f91800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787833952.846909:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:0.0:1787833952.846942:0:6502:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df503f96800: total 0 00010000:00010000:0.0:1787833952.847013:0:6502:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df503f96800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787833952.847056:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833952.847060:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787833952.847070:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1d984 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ec4f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833952.847084:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4724ace-a769-4adb-acca-a2bfbc389c92+20:2397:x1874679382001408:12345-192.168.203.17@tcp:39:umount.0 Request processed in 280us (499us total) trans 4294967527 rc 0/0 00010000:00010000:0.0:1787833952.847092:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df503f08f00) 00000100:00100000:1.0:1787833952.847096:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 258 00010000:00010000:0.0:1787833952.847097:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833952.847104:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1d62e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb61 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847125:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:0.0:1787833952.847143:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833952.847151:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1e291 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eecc expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847167:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833952.847169:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787833952.847173:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fe00/0x996d2fb20dc1dccc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed2f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847184:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df63c0c5600) 00010000:00010000:0.0:1787833952.847186:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833952.847190:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ee00/0x996d2fb20dc1d612 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb5a expref: 16 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847203:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833952.847206:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787833952.847209:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1dd66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed59 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847220:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833952.847223:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833952.847226:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1dbc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ece9 expref: 14 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847237:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:0.0:1787833952.847248:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787833952.847252:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1e39b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef12 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847276:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8df602ff4100) 00010000:00010000:0.0:1787833952.847278:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787833952.847282:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1d689 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb76 expref: 12 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847295:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8df503f0ec00) 00010000:00010000:0.0:1787833952.847298:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833952.847301:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1e371 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef04 expref: 11 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847317:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8df503f0e400) 00010000:00010000:0.0:1787833952.847319:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833952.847323:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1dca2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed21 expref: 10 pid: 13407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847336:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8df503f0e500) 00010000:00010000:0.0:1787833952.847338:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787833952.847341:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676800/0x996d2fb20dc1e053 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ee32 expref: 9 pid: 9772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847355:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f0e100) 00010000:00010000:0.0:1787833952.847357:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833952.847360:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1dd4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ed52 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.847368:0:6502:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df503f96800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787833952.847382:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833952.847389:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833952.847391:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833952.863850:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833952.870198:0:9772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382001536 00000100:00100000:1.0:1787833952.870213:0:9772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382001536 00000100:00100000:1.0:1787833952.870290:0:9772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 259 00000100:00100000:1.0:1787833952.870300:0:9772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+5:2397:x1874679382001536:12345-192.168.203.17@tcp:39:umount.0 00000020:00000080:1.0:1787833952.870330:0:9772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d2ed 00000100:00080000:1.0:1787833952.870346:0:9772:0:(import.c:65:import_set_state_nolock()) ffff8df635a18800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787833952.870374:0:9772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787833952.870515:0:9772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4724ace-a769-4adb-acca-a2bfbc389c92+3:2397:x1874679382001536:12345-192.168.203.17@tcp:39:umount.0 Request processed in 217us (6675us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787833952.870523:0:9772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 259 00010000:00010000:0.0:1787833952.873556:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833953.047707:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833953.622057:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406162816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787833953.622159:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833953.622376:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406162816 00000100:00100000:1.0:1787833953.622384:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406162816 00000100:00100000:1.0:1787833953.622458:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787833953.622466:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406162816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787833953.622498:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787833953.622562:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406162816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833953.622569:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787833953.622663:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406162816:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787833954.069917:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833954.134066:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833954.134093:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406162944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833954.134180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833954.134415:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406163200:0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.134459:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833954.134481:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406163712:0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.134504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833954.134536:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406164224:0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.134556:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833954.134573:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787833954.134578:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406163328:0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.134611:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833954.134626:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504570f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406163840:0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.134645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833954.134656:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406164352:0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.134671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833954.134699:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406163200 00000100:00100000:0.0:1787833954.134705:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406163200 00000100:00100000:0.0:1787833954.134739:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406163712 00000100:00100000:0.0:1787833954.134741:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406163712 00000100:00100000:0.0:1787833954.134786:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406164224 00000100:00100000:0.0:1787833954.134789:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406164224 00000100:00100000:0.0:1787833954.134803:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406163840 00000100:00100000:0.0:1787833954.134805:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406163840 00000100:00100000:0.0:1787833954.134817:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406164352 00000100:00100000:0.0:1787833954.134819:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406164352 00000100:00100000:0.0:1787833954.134856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787833954.134864:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406163200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.134919:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406163200:12345-0@lo:400:kworker.0 Request processed in 56us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.134926:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787833954.134944:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787833954.134951:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406163712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.134994:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406163712:12345-0@lo:400:kworker.0 Request processed in 44us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.135000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787833954.135011:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787833954.135016:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406164224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.135041:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406164224:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.135046:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787833954.135055:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787833954.135060:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406163840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.135080:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406163840:12345-0@lo:400:kworker.0 Request processed in 21us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.135085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787833954.135095:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787833954.135100:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406164352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.135120:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406164352:12345-0@lo:400:kworker.0 Request processed in 21us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.135125:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:0.0:1787833954.135146:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787833954.135150:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787833954.135176:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504570f00 x1874679406163840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833954.135189:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504570f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406163840:0@lo:400:kworker.0 00010000:00080000:0.0:1787833954.135200:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a9b840 x1874679406164352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833954.135208:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406164352:0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.135217:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406163200:0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.135225:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406163712:0@lo:400:kworker.0 00000100:00100000:0.0:1787833954.135232:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406164224:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135329:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406163328 00000100:00100000:2.0:1787833954.135333:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406163328 00000100:00100000:2.0:1787833954.135367:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787833954.135373:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406163328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135412:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406163328:12345-0@lo:400:kworker.0 Request processed in 39us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833954.135418:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787833954.135444:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406163456:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833954.135492:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406163968:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833954.135534:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406164480:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833954.135573:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787833954.135580:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406163072:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833954.135629:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504572d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406163584:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833954.135664:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504573840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406164096:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833954.135711:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406163072 00000100:00100000:2.0:1787833954.135714:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406163072 00000100:00100000:2.0:1787833954.135740:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1787833954.135746:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406163072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135819:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406163072:12345-0@lo:400:kworker.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833954.135826:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1787833954.135851:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406163584 00000100:00100000:2.0:1787833954.135853:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406163584 00000100:00100000:2.0:1787833954.135869:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787833954.135873:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406163584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135893:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406163584:12345-0@lo:400:kworker.0 Request processed in 20us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833954.135897:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787833954.135911:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406163968 00000100:00100000:2.0:1787833954.135913:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406163968 00000100:00100000:2.0:1787833954.135932:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406164480 00000100:00100000:2.0:1787833954.135933:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406164480 00000100:00100000:2.0:1787833954.135939:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406164096 00000100:00100000:2.0:1787833954.135940:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406164096 00000100:00100000:2.0:1787833954.135948:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787833954.135951:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406163968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.135992:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406163968:12345-0@lo:400:kworker.0 Request processed in 39us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833954.136002:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787833954.136013:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787833954.136019:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406164480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.136045:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406164480:12345-0@lo:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833954.136051:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787833954.136061:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787833954.136067:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406162944 00000100:00100000:1.0:1787833954.136071:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406162944 00000100:00100000:2.0:1787833954.136073:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406164096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833954.136099:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787833954.136100:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406164096:12345-0@lo:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833954.136106:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787833954.136106:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406162944:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787833954.136122:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833954.136125:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787833954.136127:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787833954.136133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406163456 00000100:00100000:2.0:1787833954.136135:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406163456 00000100:00100000:2.0:1787833954.136158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1787833954.136159:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406162944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833954.136163:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406163456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833954.136166:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787833954.136190:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406163456:12345-0@lo:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833954.136196:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787833954.136223:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406163072:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.136234:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504572d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406163584:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.136243:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504573840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406164096:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.136252:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406163456:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.136260:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406163968:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.136267:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406164480:0@lo:400:kworker.0 00000100:00100000:2.0:1787833954.136286:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833954.136291:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406164608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787833954.136315:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833954.136443:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504571e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406162944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833954.137074:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406163328:0@lo:400:kworker.0 00000100:00100000:1.0:1787833954.137237:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406164608 00000100:00100000:1.0:1787833954.137241:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406164608 00000100:00100000:1.0:1787833954.137277:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787833954.137282:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621339e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406164608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787833954.137297:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787833954.137338:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621339e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406164608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833954.137342:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787833954.137902:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406164608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833954.571927:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833954.571981:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833954.572146:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833954.579028:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382001664 00000100:00100000:1.0:1787833954.579041:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382001664 00000100:00100000:1.0:1787833954.579209:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382001792 00000100:00100000:1.0:1787833954.579213:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382001792 00000100:00100000:1.0:1787833954.579225:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382001920 00000100:00100000:1.0:1787833954.579227:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382001920 00000100:00100000:1.0:1787833954.579264:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:1.0:1787833954.579274:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e160050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+12:2398:x1874679382001664:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833954.579290:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833954.579309:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f200/0x996d2fb20dc1d3e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea88 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.579327:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833954.579382:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e160050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+11:2398:x1874679382001664:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 110us (7464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833954.579390:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:1.0:1787833954.579478:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:1.0:1787833954.579485:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+10:2399:x1874679382001792:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833954.579494:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833954.579503:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b246400/0x996d2fb20dc1d3f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eab9 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833954.579827:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787833954.579838:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cc589ca-8d60-40bb-ae0e-5988c094f6be+9:2398:x1874679382001920:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833954.579847:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833954.579857:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1d5a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91eb45 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.579866:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833954.579887:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7cc589ca-8d60-40bb-ae0e-5988c094f6be+8:2398:x1874679382001920:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 53us (7742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833954.579893:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787833954.582333:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787833954.582388:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382002176 00000100:00100000:3.0:1787833954.582397:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382002176 00000100:00100000:3.0:1787833954.582462:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 260 00000100:00100000:3.0:1787833954.582474:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+6:2397:x1874679382002176:12345-192.168.203.17@tcp:39:umount.0 00000020:00000080:3.0:1787833954.582526:0:6515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d3fe 00000020:00010000:3.0:1787833954.582546:0:6515:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df5038aa800: total 0 00000100:00080000:3.0:1787833954.582551:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8df5038ac800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787833954.582591:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1787833954.582782:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2397:x1874679382002176:12345-192.168.203.17@tcp:39:umount.0 Request processed in 309us (457us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1787833954.582791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 260 00000100:00080000:3.0:1787833954.582829:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1787833954.582963:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df5038aa800: total 0 00010000:00010000:3.0:1787833954.582967:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833954.583009:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df5038aa800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787833954.583048:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df503f0e100) 00010000:00010000:3.0:1787833954.583063:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833954.583073:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1e3be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef20 expref: 4 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.583094:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df5038aa800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787833954.583106:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833954.583108:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833954.583110:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833954.583855:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833954.583910:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7cc589ca-8d60-40bb-ae0e-5988c094f6be+7:2399:x1874679382001792:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 4422us (11925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833954.583921:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:3.0:1787833954.589904:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787833954.590005:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382002304 00000100:00100000:2.0:1787833954.590014:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382002304 00000100:00100000:2.0:1787833954.590084:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 261 00000100:00100000:2.0:1787833954.590094:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+5:2397:x1874679382002304:12345-192.168.203.17@tcp:39:umount.0 00000020:00000080:2.0:1787833954.590133:0:13407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d405 00000100:00080000:2.0:1787833954.590142:0:13407:0:(import.c:65:import_set_state_nolock()) ffff8df5038a9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787833954.590170:0:13407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787833954.590319:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c5eda4b-a2af-428f-9382-408414ba28ec+3:2397:x1874679382002304:12345-192.168.203.17@tcp:39:umount.0 Request processed in 227us (424us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787833954.590328:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 261 00010000:00010000:0.0:1787833954.590423:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787833954.590656:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787833954.629051:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787833954.630151:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382002560 00000100:00100000:1.0:1787833954.630163:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382002560 00000100:00100000:1.0:1787833954.630276:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 401 00000100:00100000:1.0:1787833954.630287:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+7:2397:x1874679382002560:12345-192.168.203.17@tcp:251:umount.0 00000020:00000080:1.0:1787833954.630334:0:6506:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d2c3 00000020:00010000:1.0:1787833954.630342:0:6506:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df503f95800: total 0 00000100:00080000:1.0:1787833954.630347:0:6506:0:(import.c:65:import_set_state_nolock()) ffff8df503f93800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787833954.630440:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7cc589ca-8d60-40bb-ae0e-5988c094f6be+3:2397:x1874679382002560:12345-192.168.203.17@tcp:251:umount.0 Request processed in 155us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833954.630456:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 401 00000020:00010000:0.0:1787833954.630586:0:6502:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df503f95800: total 0 00010000:00010000:0.0:1787833954.630636:0:6502:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df503f95800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787833954.630669:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1d31e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ea7a expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.630686:0:6502:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df503f95800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787833954.630696:0:6502:0:(genops.c:885:class_export_put()) final put ffff8df503f95800/7cc589ca-8d60-40bb-ae0e-5988c094f6be 00010000:00010000:0.0:1787833954.630713:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833954.630715:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833954.630717:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787833954.632345:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f95800/7cc589ca-8d60-40bb-ae0e-5988c094f6be for MGS 00000020:00000080:3.0:1787833954.632529:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df503f93800 for MGS 00010000:00010000:1.0:1787833955.097739:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833955.161341:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406164736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787833955.161412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833955.161588:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406164736 00000100:00100000:0.0:1787833955.161595:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406164736 00000100:00100000:0.0:1787833955.161666:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787833955.161675:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406164736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787833955.161713:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787833955.161790:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406164736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.161798:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787833955.161841:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406164736:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787833955.798492:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787833955.991229:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833955.991236:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787833955.991331:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787833955.991338:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787833956.120201:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787833956.242311:0:15151:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787833956.253028:0:15151:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787833956.253096:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.253128:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.253144:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.253152:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.253179:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787833956.253184:0:15151:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787833956.253220:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787833956.253224:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787833956.253235:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1787833956.253261:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1787833956.253264:0:15151:0:(import.c:65:import_set_state_nolock()) ffff8df61045b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787833956.253270:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.253280:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833956.253284:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.253293:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833956.253300:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833956.253305:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787833956.253307:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787833956.253310:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787833956.253335:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.253341:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787833956.253396:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406164992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833956.253459:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833956.254518:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.254727:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b246600/0x996d2fb20dc1d379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d380 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.254741:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833956.254744:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833956.254748:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833956.254791:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406164864:0@lo:39:umount.0 00000100:00100000:1.0:1787833956.254839:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833956.257636:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406164992 00000100:00100000:3.0:1787833956.257648:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406164992 00000100:00100000:3.0:1787833956.258329:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787833956.258339:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3641:x1874679406164992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833956.258355:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833956.258376:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1d380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d379 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.258393:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833956.258459:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3641:x1874679406164992:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (5000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833956.258480:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787833956.258538:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406164992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833956.258998:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406164864 00000100:00100000:1.0:1787833956.259005:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406164864 00000100:00100000:1.0:1787833956.259045:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787833956.259052:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874679406164864:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787833956.259077:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ceda 00000100:00080000:1.0:1787833956.259086:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8df634373800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787833956.259150:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1874679406164864:12345-0@lo:39:umount.0 Request processed in 98us (4310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833956.259157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1787833956.259163:0:6513:0:(genops.c:885:class_export_put()) final put ffff8df61045d800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787833956.259186:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787833956.259209:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61045b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787833956.259221:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406164864:0@lo:39:umount.0 00000020:00000080:1.0:1787833956.259245:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61045d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787833956.259297:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df634373800 for lustre-MDT0000 00000100:00080000:3.0:1787833956.259672:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787833956.259676:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787833956.259680:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787833956.260727:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260741:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260772:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260779:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260800:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833956.260806:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260812:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260817:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260824:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.260832:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833956.260839:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260848:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833956.260853:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.260855:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833956.260859:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260860:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260866:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.260867:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260873:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833956.260875:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833956.260881:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833956.260882:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787833956.260884:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787833956.260887:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260893:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260898:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260904:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.260909:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1787833956.260912:0:15151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1787833956.260913:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.260918:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1787833956.260921:0:15151:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1787833956.260938:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.260957:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b7400/0x996d2fb20dc1d387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d38e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787833956.260962:0:15151:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787833956.260966:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787833956.260970:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1787833956.260970:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787833956.260973:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787833956.260975:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:1.0:1787833956.260979:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e200 already unused, calling callback (ffffffffc1230c20) 00000020:00080000:3.0:1787833956.260981:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df5039c7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1787833956.260982:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833956.260987:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df63c484800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787833956.260991:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df63c3bc800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787833956.260996:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df63b15b800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:1.0:1787833956.260998:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833956.261003:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8df5038aa800 4c5eda4b-a2af-428f-9382-408414ba28ec 192.168.203.17@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1787833956.261004:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833956.261008:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8df503f96800 a4724ace-a769-4adb-acca-a2bfbc389c92 192.168.203.17@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 10000000:01000000:1.0:1787833956.261010:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787833956.261012:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00080000:3.0:1787833956.261013:0:15151:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8df60ec71a48) has exports, disconnecting them 10000000:01000000:1.0:1787833956.261014:0:7455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:3.0:1787833956.261017:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df5039c7800), last request at 1787833954 00000020:00000080:3.0:1787833956.261022:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d1ea 00010000:00010000:1.0:1787833956.261027:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261031:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1787833956.261036:0:15151:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787833956.261037:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261042:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1d27d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d284 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261050:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787833956.261053:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261059:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833956.261062:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261068:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833956.261072:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df5039c7800): rc 0 00000020:00000080:3.0:1787833956.261074:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df5039c7800/lustre-MDT0000-lwp-OST0001_UUID 10000000:00010000:1.0:1787833956.261082:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833956.261083:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df63c484800), last request at 1787833954 00000020:00000080:3.0:1787833956.261086:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d0cb 10000000:01000000:1.0:1787833956.261087:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787833956.261089:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000100:00080000:3.0:1787833956.261090:0:15151:0:(import.c:65:import_set_state_nolock()) ffff8df63c486800 : changing import state from FULL to CLOSED 10000000:01000000:1.0:1787833956.261091:0:7455:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:3.0:1787833956.261096:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df63c484800): rc 0 00000020:00000080:3.0:1787833956.261098:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df63c484800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787833956.261102:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df63c3bc800), last request at 1787833714 00010000:00010000:1.0:1787833956.261104:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787833956.261105:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cfc1 00000100:00080000:3.0:1787833956.261108:0:15151:0:(import.c:65:import_set_state_nolock()) ffff8df63c3be800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787833956.261109:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1787833956.261112:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df63c3bc800): rc 0 00000020:00000080:3.0:1787833956.261114:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df63c3bc800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1787833956.261122:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787833956.261123:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df63b15b800), last request at 1787833714 00000020:00000080:3.0:1787833956.261126:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cf89 00000100:00080000:3.0:1787833956.261129:0:15151:0:(import.c:65:import_set_state_nolock()) ffff8df63c0d6800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787833956.261129:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1d5e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d5e8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1787833956.261136:0:15151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:1.0:1787833956.261137:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833956.261139:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261144:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6421c8200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787833956.261147:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261152:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833956.261157:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833956.261170:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787833956.261172:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787833956.261173:0:7455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787833956.261186:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261191:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833956.261198:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261203:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6421c8200/0x996d2fb20dc1ce39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1ce40 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.261212:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833956.261214:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833956.261216:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833956.261223:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833956.261236:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406165120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833956.261295:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833956.261339:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833956.261346:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406165248:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787833956.261351:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df63b15b800): rc 0 00000004:00000080:3.0:1787833956.261357:0:15151:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9fc9c845fae0 00000100:00080000:3.0:1787833956.261373:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787833956.261377:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1787833956.261862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787833956.261905:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039c7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787833956.261950:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c484800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787833956.261969:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c3bc800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787833956.261991:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5039c4800 for lustre-MDT0000 00000020:00000080:1.0:1787833956.261995:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df63c486800 for lustre-MDT0000 00000020:00000080:1.0:1787833956.261998:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df63c3be800 for lustre-MDT0000 00000100:00100000:1.0:1787833956.262019:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406165504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833956.262045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833956.262064:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833956.262069:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406165376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833956.262088:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833956.262112:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406165120 00000100:00100000:1.0:1787833956.262118:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406165120 00000100:00100000:1.0:1787833956.262147:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406165248 00000100:00100000:1.0:1787833956.262149:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406165248 00000100:00100000:1.0:1787833956.262158:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406165504 00000100:00100000:1.0:1787833956.262160:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406165504 00000100:00100000:1.0:1787833956.262168:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406165376 00000100:00100000:1.0:1787833956.262170:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406165376 00000100:00100000:1.0:1787833956.262183:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787833956.262190:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+26:3638:x1874679406165120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833956.262201:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833956.262215:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b247a00/0x996d2fb20dc1d38e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d387 expref: 26 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.262228:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833956.262255:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+25:3638:x1874679406165120:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833956.262262:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787833956.262276:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787833956.262280:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+24:3638:x1874679406165248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833956.262288:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833956.262295:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f000/0x996d2fb20dc1d284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d27d expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.262313:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833956.262332:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+23:3638:x1874679406165248:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833956.262338:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787833956.262349:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787833956.262354:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+22:3641:x1874679406165504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833956.262361:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833956.262381:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df601535200/0x996d2fb20dc1ce40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1ce39 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.262390:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1787833956.262392:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787833956.262408:0:15151:0:(import.c:65:import_set_state_nolock()) ffff8df63b1df800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787833956.262412:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+21:3641:x1874679406165504:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833956.262418:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787833956.262429:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787833956.262434:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e163450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+20:3641:x1874679406165376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833956.262441:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833956.262449:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b7600/0x996d2fb20dc1d5e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d5e1 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.262457:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833956.262478:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e163450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3641:x1874679406165376:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833956.262483:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787833956.262546:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406165248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833956.262555:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406165120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833956.262593:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406165632:0@lo:39:umount.0 00000100:00100000:1.0:1787833956.262618:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833956.262670:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406165376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833956.262677:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406165504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833956.262693:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833956.262733:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406165632 00000100:00100000:3.0:1787833956.262738:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406165632 00000100:00100000:3.0:1787833956.262788:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787833956.262795:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874679406165632:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787833956.262817:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d01c 00000100:00080000:3.0:1787833956.262823:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8df6359bd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787833956.262837:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787833956.262937:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3637:x1874679406165632:12345-0@lo:39:umount.0 Request processed in 143us (317us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787833956.262955:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00010000:1.0:1787833956.265295:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787833956.265348:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df63b1df800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787833956.265361:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406165632:0@lo:39:umount.0 00000100:00080000:0.0:1787833956.266726:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787833956.266732:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1787833956.267032:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787833956.267802:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787833956.267832:0:15151:0:(import.c:65:import_set_state_nolock()) ffff8df502d1f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787833956.267853:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787833956.267856:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1787833956.267868:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787833956.267923:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787833956.267930:0:15151:0:(import.c:65:import_set_state_nolock()) ffff8df503f94800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787833956.267966:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8df60ec71a48) has no exports 00000100:00100000:2.0:1787833956.268303:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406165760:0@lo:9:umount.0 00000100:00100000:2.0:1787833956.268366:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833956.268393:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406165888:0@lo:9:umount.0 00000100:00100000:2.0:1787833956.268411:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833956.268441:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406165760 00000100:00100000:2.0:1787833956.268447:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406165760 00000100:00100000:2.0:1787833956.268717:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406165888 00000100:00100000:2.0:1787833956.268722:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406165888 00000100:00100000:2.0:1787833956.268775:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787833956.268786:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874679406165760:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787833956.268810:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d16c 00000100:00080000:2.0:1787833956.268817:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8df502eb4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787833956.268859:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787833956.269008:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3637:x1874679406165760:12345-0@lo:9:umount.0 Request processed in 223us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833956.269018:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787833956.269050:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787833956.269057:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874679406165888:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787833956.269069:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d2ae 00000100:00080000:2.0:1787833956.269076:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8df503db4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787833956.269099:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:3.0:1787833956.269296:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833956.269300:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833956.269483:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3637:x1874679406165888:12345-0@lo:9:umount.0 Request processed in 426us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833956.269491:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1787833956.269522:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787833956.269550:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502d1f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787833956.269570:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787833956.269572:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787833956.269576:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406165760:0@lo:9:umount.0 00000100:00080000:2.0:1787833956.269587:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df503f94800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787833956.269598:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787833956.269600:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787833956.269602:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406165888:0@lo:9:umount.0 00010000:00010000:2.0:1787833956.269621:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787833956.278259:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8df60ec71a48) has no exports 00000020:00000080:2.0:1787833956.352387:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ce94 00000020:00000080:2.0:1787833956.352402:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df634377800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787833956.352469:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787833956.352568:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833956.352578:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787833956.352582:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8df62ea94ed8) has no exports 00000020:00000080:3.0:1787833956.352866:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ce8d 00000020:00000080:3.0:1787833956.352872:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df63435e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787833956.353097:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df634377800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787833956.358264:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833956.358280:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787833956.358286:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df62eaa3800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787833956.358291:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62eaa3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787833956.358301:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787833956.359062:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63435e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1787833956.695857:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406166016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787833956.695930:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833956.696087:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406166016 00000100:00100000:1.0:1787833956.696096:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406166016 00000100:00100000:1.0:1787833956.696165:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787833956.696175:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406166016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833956.696204:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787833956.696257:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406166016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833956.696264:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1787833956.696324:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833956.696358:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406166016:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787833957.142088:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833958.166173:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833959.191035:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833959.254469:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406166144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787833959.254541:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833959.254576:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406166528:0@lo:400:kworker.0 00000100:00100000:0.0:1787833959.254618:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406166656:0@lo:400:kworker.0 00000100:00100000:2.0:1787833959.254619:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833959.254646:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406167040:0@lo:400:kworker.0 00000100:00100000:0.0:1787833959.254654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833959.254676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833959.254682:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406167168:0@lo:400:kworker.0 00000100:00100000:0.0:1787833959.254712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833959.254908:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406166144 00000100:00100000:3.0:1787833959.254915:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406166144 00000100:00100000:3.0:1787833959.254979:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787833959.254989:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406166144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787833959.255019:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833959.255113:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406166144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833959.255120:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787833959.256701:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406166528 00000100:00100000:2.0:1787833959.256714:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406166528 00000100:00100000:2.0:1787833959.256899:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406166656 00000100:00100000:2.0:1787833959.256904:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406166656 00000100:00100000:2.0:1787833959.256915:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406167040 00000100:00100000:2.0:1787833959.256917:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406167040 00000100:00100000:2.0:1787833959.256994:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406167168 00000100:00100000:2.0:1787833959.256997:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406167168 00000100:00100000:2.0:1787833959.257024:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787833959.257035:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406167168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833959.257117:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406167168:12345-0@lo:400:kworker.0 Request processed in 85us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833959.257191:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787833959.257211:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787833959.257215:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1874679406166528:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787833959.257221:0:13407:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787833959.257257:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1874679406166528:12345-0@lo:400:kworker.0 Request processed in 40us (2640us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787833959.257264:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787833959.257276:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787833959.257279:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1874679406166656:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787833959.257297:0:13407:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787833959.257399:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1874679406166656:12345-0@lo:400:kworker.0 Request processed in 117us (2745us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787833959.257406:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787833959.257419:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787833959.257422:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1874679406167040:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787833959.257426:0:13407:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787833959.257452:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1874679406167040:12345-0@lo:400:kworker.0 Request processed in 28us (2776us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787833959.257457:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1787833959.259840:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787833959.259848:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8df634359000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787833959.259853:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787833959.263775:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406166400:0@lo:400:kworker.0 00000100:00100000:0.0:1787833959.263951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833959.263998:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406166272:0@lo:400:kworker.0 00000100:00100000:1.0:1787833959.264036:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833959.264079:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406166784:0@lo:400:kworker.0 00000100:00100000:1.0:1787833959.264103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833959.264179:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406167296:0@lo:400:kworker.0 00000100:00100000:1.0:1787833959.264204:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833959.264239:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406166784 00000100:00100000:3.0:1787833959.264248:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406166784 00000100:00100000:3.0:1787833959.264309:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787833959.264321:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406166912:0@lo:400:kworker.0 00000100:00100000:0.0:1787833959.264357:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406166400 00000100:00100000:0.0:1787833959.264367:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406166400 00000100:00100000:3.0:1787833959.264379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406166784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833959.264394:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787833959.264399:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1874679406166400:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787833959.264406:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787833959.264441:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406166784:12345-0@lo:400:kworker.0 Request processed in 123us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833959.264448:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00080000:3.0:1787833959.264478:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787833959.264482:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833959.264938:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1874679406166400:12345-0@lo:400:kworker.0 Request processed in 535us (986us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787833959.264948:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:1.0:1787833959.264967:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec7480 x1874679406166784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833959.264979:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833959.264987:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406166784:0@lo:400:kworker.0 00000100:00080000:0.0:1787833959.265021:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787833959.265026:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8df63b3dc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787833959.265031:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787833959.265036:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8df63b3dc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787833959.265040:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787833959.265043:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 190 00000100:00080000:1.0:1787833959.265045:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8df62ea25800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787833959.265051:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787833959.265053:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8df63b3dc000 using connection 192.168.203.117@tcp/0@lo 00000100:00080000:1.0:1787833959.265056:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8df62ea25800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787833959.265061:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 214 00000100:00080000:1.0:1787833959.265066:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df62ea25800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787833959.265087:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502508780 x1874679406167424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787833959.265107:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406166656:0@lo:400:kworker.0 00010000:00080000:1.0:1787833959.265121:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ec4000 x1874679406167168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833959.265130:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406167168:0@lo:400:kworker.0 00000100:00100000:1.0:1787833959.265149:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406166144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787833959.265666:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406167296 00000100:00100000:3.0:1787833959.265672:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406167296 00000100:00100000:3.0:1787833959.265718:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406166912 00000100:00100000:3.0:1787833959.265722:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406166912 00000100:00100000:3.0:1787833959.265766:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787833959.265775:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406167296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833959.265835:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406167296:12345-0@lo:400:kworker.0 Request processed in 63us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833959.265842:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787833959.265854:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787833959.265860:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406166912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833959.265908:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406166912:12345-0@lo:400:kworker.0 Request processed in 48us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833959.265914:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787833959.265940:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406166272 00000100:00100000:3.0:1787833959.265944:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406166272 00000100:00100000:3.0:1787833959.265968:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1787833959.265975:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3640:x1874679406166272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833959.266006:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f2e78c7-534c-47b7-a20f-32c44fb24136+19:3640:x1874679406166272:12345-0@lo:400:kworker.0 Request processed in 31us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833959.266012:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00080000:3.0:1787833959.266037:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833959.266062:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3f2e78c7-534c-47b7-a20f-32c44fb24136:3640:1874679406166272:0@lo:400:kworker.0 00000100:00100000:3.0:1787833959.266075:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406167296:0@lo:400:kworker.0 00000100:00100000:0.0:1787833959.266916:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a99680 x1874679406167552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787833959.266947:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406166400:0@lo:400:kworker.0 00000100:00100000:0.0:1787833959.266970:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406166912:0@lo:400:kworker.0 00000100:00100000:1.0:1787833959.267148:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406167424:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787833959.267201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833959.267232:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406167552:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787833959.267320:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833959.267454:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406167552 00000100:00100000:1.0:1787833959.267473:0:7823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406167552 00000100:00100000:1.0:1787833959.267501:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787833959.267507:0:7823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1874679406167552:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787833959.267521:0:7823:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787833959.268141:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406167424 00000100:00100000:3.0:1787833959.268148:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406167424 00000100:00100000:3.0:1787833959.268187:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787833959.268193:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406167424:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787833959.268204:0:6513:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787833959.268263:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406167424:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 68us (1061us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787833959.268269:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1787833959.268302:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df62ea25800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833959.268307:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833959.268311:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406167424:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:3.0:1787833959.269817:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787833959.269837:0:8424:0:(genops.c:885:class_export_put()) final put ffff8df502eb7800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787833959.269855:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:3.0:1787833959.269858:0:8424:0:(genops.c:885:class_export_put()) final put ffff8df50474a000/a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:3.0:1787833959.269873:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502eb7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787833959.269933:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df50474a000/a4724ace-a769-4adb-acca-a2bfbc389c92 for lustre-OST0000 00000020:00000080:3.0:1787833959.269955:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502eb4800 for lustre-OST0000 00000020:00000080:3.0:1787833959.269959:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df50474d000 for lustre-OST0000 00000001:00100000:3.0:1787833959.272473:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787833959.272483:0:9510:0:(genops.c:885:class_export_put()) final put ffff8df503db2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787833959.272511:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:3.0:1787833959.272514:0:9510:0:(genops.c:885:class_export_put()) final put ffff8df5047ab000/a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:0.0:1787833959.272541:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503db2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787833959.272590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5047ab000/a4724ace-a769-4adb-acca-a2bfbc389c92 for lustre-OST0001 00000020:00000080:0.0:1787833959.272607:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df503db4000 for lustre-OST0001 00000020:00000080:0.0:1787833959.272612:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5047af800 for lustre-OST0001 00000100:00080000:2.0:1787833959.279441:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8df634359000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833959.280160:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 190 00000100:00080000:2.0:1787833959.280171:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8df634359000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833959.280214:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df504602580 x1874679406167680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833959.280293:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504602580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406167680:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787833959.280375:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833959.280439:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406166528:0@lo:400:kworker.0 00000100:00080000:2.0:1787833959.280476:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787833959.280480:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787833959.280483:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787833959.280487:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833959.280490:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 240 00000100:00080000:2.0:1787833959.280508:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df5039c4000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833959.280522:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df5046021c0 x1874679406167808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787833959.280669:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406167680 00000100:00100000:0.0:1787833959.280676:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406167680 00000100:00100000:0.0:1787833959.280712:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787833959.280720:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406167680:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787833959.280740:0:6515:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787833959.283937:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406167808:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787833959.284017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833959.286471:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406167040:0@lo:400:kworker.0 00000100:00100000:2.0:1787833959.286560:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406167808 00000100:00100000:2.0:1787833959.286569:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406167808 00000100:00100000:2.0:1787833959.286612:0:13407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787833959.286619:0:13407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1874679406167808:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787833959.286636:0:13407:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787833959.286709:0:13407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1874679406167808:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 89us (2691us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787833959.286715:0:13407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000001:00100000:2.0:1787833959.288290:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787833959.288296:0:6492:0:(genops.c:885:class_export_put()) final put ffff8df63b15b800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787833959.288326:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c5eda4b-a2af-428f-9382-408414ba28ec 00000001:00080000:2.0:1787833959.288334:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1787833959.288337:0:6492:0:(genops.c:885:class_export_put()) final put ffff8df5038aa800/4c5eda4b-a2af-428f-9382-408414ba28ec 00000001:00100000:2.0:1787833959.288342:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000001:00080000:2.0:1787833959.288348:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787833959.288355:0:6492:0:(genops.c:885:class_export_put()) final put ffff8df503f96800/a4724ace-a769-4adb-acca-a2bfbc389c92 00000001:00100000:2.0:1787833959.288400:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787833959.288407:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1787833959.288409:0:7445:0:(genops.c:885:class_export_put()) final put ffff8df63c0d3000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787833959.288413:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4c5eda4b-a2af-428f-9382-408414ba28ec 00000001:00080000:2.0:1787833959.288419:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1787833959.288420:0:7445:0:(genops.c:885:class_export_put()) final put ffff8df5038a8800/4c5eda4b-a2af-428f-9382-408414ba28ec 00000001:00100000:2.0:1787833959.288424:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a4724ace-a769-4adb-acca-a2bfbc389c92 00000001:00080000:2.0:1787833959.288456:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1787833959.288460:0:7445:0:(genops.c:885:class_export_put()) final put ffff8df503f95000/a4724ace-a769-4adb-acca-a2bfbc389c92 00000020:00000080:2.0:1787833959.288486:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b15b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787833959.288532:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5038aa800/4c5eda4b-a2af-428f-9382-408414ba28ec for lustre-MDT0000 00000020:00000080:2.0:1787833959.288556:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f96800/a4724ace-a769-4adb-acca-a2bfbc389c92 for lustre-MDT0000 00000020:00000080:2.0:1787833959.288580:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c0d3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787833959.288608:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5038a8800/4c5eda4b-a2af-428f-9382-408414ba28ec for lustre-MDT0001 00000020:00000080:2.0:1787833959.288626:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f95000/a4724ace-a769-4adb-acca-a2bfbc389c92 for lustre-MDT0001 00000020:00000080:2.0:1787833959.288647:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df63c0d6800 for lustre-MDT0000 00000020:00000080:2.0:1787833959.288651:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5038ac800 for lustre-MDT0000 00000020:00000080:2.0:1787833959.288655:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df503f91800 for lustre-MDT0000 00000020:00000080:2.0:1787833959.288658:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df6359bd800 for lustre-MDT0001 00000020:00000080:2.0:1787833959.288661:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5038a9800 for lustre-MDT0001 00000020:00000080:2.0:1787833959.288663:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df635a18800 for lustre-MDT0001 00000100:00100000:0.0:1787833959.294533:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406167680:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 13803us (14148us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787833959.294548:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1787833959.299742:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df634359000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833959.299769:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833959.299774:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504602580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406167680:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1787833959.299828:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833959.299832:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833959.299835:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406167808:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787833959.305907:0:7823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1874679406167552:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 38390us (38578us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787833959.305929:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1787833959.305979:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df63b3dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833959.305985:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833959.305990:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406167552:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1787833960.213962:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833961.240662:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833961.814071:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406167936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787833961.814211:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833961.814405:0:11278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406167936 00000100:00100000:1.0:1787833961.814412:0:11278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406167936 00000100:00100000:1.0:1787833961.814482:0:11278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787833961.814500:0:11278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406167936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787833961.814530:0:11278:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787833961.814581:0:11278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406167936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833961.814588:0:11278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1787833961.814743:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833961.815229:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406167936:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787833962.264000:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787833962.454193:0:15151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df502ecf720 - data ffff8df62eda1870/ffff8df503eff400 00000020:01000000:2.0:1787833962.454357:0:15151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df63b09d660 - data ffff8df62ecb3438/ffff8df62ea37000 00000001:00000004:2.0:1787833962.463401:0:15151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1787833962.542148:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787833962.542156:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787833962.542170:0:15151:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8df502ec70c0 x1874679406165632/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787833966 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833962.542464:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787833962.545686:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787833962.545694:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1787833962.545832:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787833962.545846:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787833962.550119:0:8580:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787833962.550127:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787833962.550138:0:8580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787833962.552066:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787833962.552073:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1787833962.552092:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787833962.552095:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787833962.552556:0:9986:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787833962.552560:0:9986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787833962.552570:0:9986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787833962.569565:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ce5c 00000020:00000080:2.0:1787833962.569577:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df60ef1d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787833962.570665:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef1d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787833962.582186:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ce71 00000020:00000080:2.0:1787833962.582201:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df62eaa3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787833962.582228:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787833962.582234:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833962.582241:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787833962.582245:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8df60ec74ed8) has no exports 00000004:01000000:2.0:1787833962.582650:0:15151:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787833962.582660:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d2a7 00000020:00000080:2.0:1787833962.582665:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df503f92000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787833962.582669:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787833962.582673:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833962.582681:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787833962.582694:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8df635860000) has no exports 00000020:00000080:2.0:1787833962.582701:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d2a0 00000020:00000080:2.0:1787833962.582705:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df503f91000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787833962.583048:0:15151:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787833962.583053:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787833962.583057:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1787833962.583061:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787833962.583064:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787833962.583094:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833962.583102:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787833962.583107:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d165 00000020:00000080:2.0:1787833962.583111:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df63fb41000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787833962.583115:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787833962.583117:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833962.583131:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787833962.583133:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8df5027c0000) has no exports 00000020:00000080:2.0:1787833962.583138:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d15e 00000020:00000080:2.0:1787833962.583141:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df502d18800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787833962.583431:0:15151:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787833962.583434:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787833962.583436:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1787833962.583439:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787833962.583441:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787833962.583466:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833962.583471:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787833962.583481:0:15151:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787833962.583485:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d015 00000020:00000080:2.0:1787833962.583490:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df63c3ba800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787833962.583493:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787833962.583496:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833962.583500:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787833962.583502:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8df635861a48) has no exports 00000020:00000080:2.0:1787833962.583505:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d00e 00000020:00000080:2.0:1787833962.583508:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df63b1db000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787833962.583820:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62eaa3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787833962.583835:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f92000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787833962.583840:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f91000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787833962.583845:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df503f94800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787833962.583851:0:8:0:(genops.c:885:class_export_put()) final put ffff8df63b15e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787833962.583866:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b15e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787833962.583870:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787833962.583984:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63fb41000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787833962.583990:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502d18800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787833962.583995:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502d1f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787833962.583999:0:8:0:(genops.c:885:class_export_put()) final put ffff8df502d19000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787833962.584001:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502d19000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787833962.584005:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787833962.584040:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c3ba800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787833962.584044:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b1db000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787833962.588109:0:15151:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1787833962.588118:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787833962.588123:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1787833962.588132:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787833962.588194:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833962.588207:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787833962.588237:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833962.588241:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787833962.588247:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df60ef19800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787833962.588251:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef19800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787833962.588257:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787833962.588286:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df63b1df800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787833962.588299:0:8:0:(genops.c:885:class_export_put()) final put ffff8df63c24c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787833962.588301:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c24c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787833962.588309:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787833962.588488:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ce78 00000020:00000080:3.0:1787833962.588495:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df62eaa7800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787833962.588501:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787833962.588505:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833962.588511:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1787833962.588511:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62eaa7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00080000:3.0:1787833962.588517:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8df62ea90000) has no exports 00000020:00000080:3.0:1787833962.588550:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833962.588554:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787833962.588557:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df60ef1a800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787833962.588559:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef1a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787833962.588563:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787833962.588595:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ce7f 00000020:00000080:3.0:1787833962.588599:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df62eaa6800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787833962.588620:0:15151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df60efc3000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787833962.588623:0:15151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df60efc3000 3 00000020:01000004:3.0:1787833962.588627:0:15151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df60efc3000 from lustre-MDT0000 00000020:00000080:3.0:1787833962.588646:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833962.588650:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787833962.588652:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df60ef1c000/lustre-MDT0000_UUID 00000020:00000080:3.0:1787833962.588664:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef1c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787833962.588671:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1787833962.588799:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62eaa6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1787833962.589828:0:15151:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1787833962.589836:0:15151:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787833962.589840:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787833962.589843:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833962.589847:0:15151:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787833962.589853:0:15151:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8df60ef74800 3f2e78c7-534c-47b7-a20f-32c44fb24136 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787833962.589860:0:15151:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8df60efcced8) has exports, disconnecting them 00000020:00080000:3.0:1787833962.589865:0:15151:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8df60ef74800), last request at 1787833692 00000020:00000080:3.0:1787833962.589882:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ce1d 00000020:00010000:3.0:1787833962.589887:0:15151:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df60ef74800: total 0 00000100:00080000:3.0:1787833962.589892:0:15151:0:(import.c:65:import_set_state_nolock()) ffff8df60ef76800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787833962.589912:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df60ef74800): rc 0 00000020:00080000:3.0:1787833962.589917:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8df60efcced8) has no exports 00000020:00010000:1.0:1787833962.589970:0:7455:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df60ef74800: total 0 00000100:00100000:3.0:1787833962.589998:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8df60828d200:6507] 1 exiting: rc = 0 00010000:00010000:1.0:1787833962.590026:0:7455:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df60ef74800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787833962.590060:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b200/0x996d2fb20dc1d33a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d333 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.590080:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b6a00/0x996d2fb20dc1d348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d341 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833962.590089:0:6508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8df611f24a00:6508] 2 exiting: rc = 0 00010000:00010000:1.0:1787833962.590108:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b247000/0x996d2fb20dc1d364 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d35d expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.590125:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6013fc000/0x996d2fb20dc1cf19 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1cf12 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.590145:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1d356 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d34f expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.590154:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1d372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d36b expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.590164:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df6013fc800/0x996d2fb20dc1cf27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1cf20 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.590177:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1d5be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d5b7 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.590186:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b6e00/0x996d2fb20dc1d5cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d5c5 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.591379:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b246e00/0x996d2fb20dc1d39c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d395 expref: 5 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.592319:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1d32c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d325 expref: 4 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.592337:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b6000/0x996d2fb20dc1d5da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d5d3 expref: 3 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.593262:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600030800/0x996d2fb20dc1d23e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1d237 expref: 2 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833962.593276:0:7455:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df60ef74800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787833962.593334:0:7455:0:(genops.c:885:class_export_put()) final put ffff8df60ef74800/3f2e78c7-534c-47b7-a20f-32c44fb24136 00010000:00010000:1.0:1787833962.593359:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833962.593362:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833962.593364:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787833962.593771:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef74800/3f2e78c7-534c-47b7-a20f-32c44fb24136 for MGS 00000020:00000080:3.0:1787833962.593809:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df60ef76800 for MGS 00000100:00100000:1.0:1787833962.594248:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8df63299ce00:6506] 0 exiting: rc = 1 00000100:00100000:3.0:1787833962.594564:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594578:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594590:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594600:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594606:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594611:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594616:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594622:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594634:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594642:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594647:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594653:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594659:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594676:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594681:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594687:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594692:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594697:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594703:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594708:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594714:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594720:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594726:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594731:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594738:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594744:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594770:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594777:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594782:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594787:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594791:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594796:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594801:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594806:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594812:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594819:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594824:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594830:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594835:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594840:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594846:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594851:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594856:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594861:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594868:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594872:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594879:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594884:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594909:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594915:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594920:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594925:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594931:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594936:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594941:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594945:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594950:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594954:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594959:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594964:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594968:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594973:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594978:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833962.594984:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1787833962.596231:0:15151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df502ecf960 - data ffff8df62ec74e58/ffff8df503fa1400 00000020:01000000:3.0:1787833962.596346:0:15151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df60ed18f60 - data ffff8df62ecb1d80/ffff8df610b40800 00000020:00000080:3.0:1787833962.596797:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ce01 00000020:00000080:3.0:1787833962.596807:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df620728000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787833962.596832:0:15151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df60efc3000 from MGS, refs=2 00000020:01000004:3.0:1787833962.596835:0:15151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df60efc3000 2 00000020:01000004:3.0:1787833962.596839:0:15151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df60efc3000 from MGS 00000020:00000080:1.0:1787833962.596844:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df620728000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787833962.596865:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833962.596872:0:15151:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787833962.596874:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df62072a800/MGS 00000020:00000080:3.0:1787833962.596877:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62072a800/MGS for MGS 00000020:01000000:3.0:1787833962.596883:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787833962.596951:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787833962.596955:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833962.596960:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787833962.596966:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8df610459000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787833962.596971:0:15151:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8df60efc9a48) has exports, disconnecting them 00000020:00080000:3.0:1787833962.596983:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8df610459000), last request at 1787833693 00000020:00000080:3.0:1787833962.596986:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cecc 00000020:00080000:3.0:1787833962.596997:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df610459000): rc 0 00000020:00000080:3.0:1787833962.597002:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df610459000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787833962.597460:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df610459000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787833962.605826:0:15151:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787833962.605836:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787833962.605841:0:15151:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787833962.605848:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787833962.605907:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df61045b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787833962.606094:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787833962.606103:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787833962.606109:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df634374000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787833962.606113:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff8df634374000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787833962.606135:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787833962.606241:0:15151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df60efc3000 1 00000020:00000080:1.0:1787833962.606247:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cdf3 00000020:00000080:1.0:1787833962.606252:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df62072a000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787833962.606261:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787833962.606269:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62072a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787833962.606278:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787833962.606283:0:15151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787833962.606294:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8df60ef4ced8) has no exports 00000020:00000080:0.0:1787833962.716221:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787833962.716233:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787833962.716238:0:15151:0:(genops.c:885:class_export_put()) final put ffff8df60efc0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787833962.716242:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60efc0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787833962.716247:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787833962.716355:0:15151:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df60efc4800 00000020:02000400:0.0:1787833962.716458:0:15151:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787833963.286267:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833964.312690:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833964.373935:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833964.373960:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406168064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787833964.374024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833964.374284:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406168064 00000100:00100000:3.0:1787833964.374291:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406168064 00000100:00100000:3.0:1787833964.374368:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787833964.374377:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406168064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787833964.374406:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787833964.374454:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406168064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833964.374461:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787833964.374508:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406168064:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787833964.375215:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833964.375221:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787833964.375224:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df63b3dc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833964.375230:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1787833964.375234:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787833964.375239:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8df63b3dc000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833964.375262:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df504600b40 x1874679406168320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787833964.375278:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833964.375296:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787833964.375298:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df634359000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833964.375301:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1787833964.375304:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787833964.375308:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8df634359000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833964.375320:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df504602d00 x1874679406168448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787833964.375329:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833964.375332:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787833964.375334:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df62ea25800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833964.375338:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1787833964.375340:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787833964.375343:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df62ea25800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833964.375353:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df5046021c0 x1874679406168576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787833964.375386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833964.375390:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787833964.375391:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833964.375394:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1787833964.375397:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787833964.375400:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df5039c4000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833964.375411:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212fcf00 x1874679406168960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787833964.375643:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833964.375781:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406168320:0@lo:38:kworker.0 00000100:00100000:3.0:1787833964.375837:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833964.375880:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504602d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406168448:0@lo:38:kworker.0 00000100:00100000:3.0:1787833964.375917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833964.375941:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406168576:0@lo:38:kworker.0 00000100:00100000:3.0:1787833964.375961:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833964.375977:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406168960:0@lo:38:kworker.0 00000100:00100000:3.0:1787833964.375995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833964.376024:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504602580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406168704:0@lo:400:kworker.0 00000100:00100000:1.0:1787833964.376185:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406168320 00000100:00100000:1.0:1787833964.376192:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406168320 00000100:00100000:1.0:1787833964.376220:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787833964.376226:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406168320:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787833964.376243:0:6519:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787833964.376285:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406168320:12345-0@lo:38:kworker.0 Request processed in 58us (448us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787833964.376291:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787833964.376905:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406168832:0@lo:400:kworker.0 00000100:00100000:2.0:1787833964.376952:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833964.376992:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406168448 00000100:00100000:2.0:1787833964.376997:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406168448 00000100:00100000:2.0:1787833964.377019:0:13407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406168576 00000100:00100000:2.0:1787833964.377021:0:13407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406168576 00000100:00100000:3.0:1787833964.377138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833964.378683:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406168960 00000100:00100000:3.0:1787833964.378699:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406168960 00000100:00100000:3.0:1787833964.378723:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406168704 00000100:00100000:3.0:1787833964.378726:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406168704 00000100:00100000:3.0:1787833964.378784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787833964.378794:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406168704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833964.378862:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406168704:12345-0@lo:400:kworker.0 Request processed in 71us (1724us total) trans 0 rc 0/0 00000100:00080000:0.0:1787833964.379283:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787833964.379330:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787833964.379352:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787833964.379357:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874679406168448:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787833964.379377:0:6514:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787833964.379416:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874679406168448:12345-0@lo:38:kworker.0 Request processed in 57us (3498us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787833964.379422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787833964.379436:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787833964.379440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874679406168576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787833964.379450:0:6514:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787833964.379473:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874679406168576:12345-0@lo:38:kworker.0 Request processed in 32us (3511us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787833964.379478:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787833964.379490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787833964.379494:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874679406168960:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787833964.379503:0:6514:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787833964.379526:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874679406168960:12345-0@lo:38:kworker.0 Request processed in 31us (3529us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787833964.379532:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787833964.379566:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406169088:0@lo:400:kworker.0 00000100:00100000:3.0:1787833964.379603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833964.379706:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833964.379712:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406168192:0@lo:400:kworker.0 00000400:00000100:3.0:1787833964.379731:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874679406168192 offset 0 length 224: 4 00000100:00080000:3.0:1787833964.379799:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df63b3dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833964.379805:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833964.379809:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406168320:0@lo:38:kworker.0 00000100:00080000:3.0:1787833964.379818:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df634359000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833964.379821:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833964.379824:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504602d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406168448:0@lo:38:kworker.0 00000100:00080000:3.0:1787833964.379832:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df62ea25800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833964.379836:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833964.379838:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406168576:0@lo:38:kworker.0 00000100:00080000:3.0:1787833964.379847:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833964.379850:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833964.379852:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406168960:0@lo:38:kworker.0 00010000:00080000:3.0:1787833964.379905:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8df504602580 x1874679406168704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833964.379919:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504602580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406168704:0@lo:400:kworker.0 00000100:00100000:0.0:1787833964.379990:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406169088 00000100:00100000:0.0:1787833964.379995:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406169088 00000100:00100000:0.0:1787833964.380110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787833964.380118:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406169088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833964.380158:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406169088:12345-0@lo:400:kworker.0 Request processed in 42us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833964.380164:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:3.0:1787833964.380218:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787833964.380237:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8df6212fc3c0 x1874679406169088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833964.380246:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406169088:0@lo:400:kworker.0 00000100:00100000:2.0:1787833964.380448:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406168832 00000100:00100000:2.0:1787833964.380454:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406168832 00000100:00100000:2.0:1787833964.380496:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787833964.380503:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406168832:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787833964.380697:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833964.381131:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406168832:12345-0@lo:400:kworker.0 Request processed in 627us (4177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833964.381139:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787833964.381178:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406168832:0@lo:400:kworker.0 00000040:00080000:2.0:1787833965.014471:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787833965.335908:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833966.358666:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787833966.430036:0:15353:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787833966.441920:0:15353:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787833966.441970:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.441984:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.442005:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.442012:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.442035:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787833966.442040:0:15353:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787833966.442065:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787833966.442069:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787833966.442074:0:15353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787833966.442080:0:15353:0:(import.c:65:import_set_state_nolock()) ffff8df634359000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787833966.442084:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787833966.442086:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787833966.442088:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787833966.443628:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833966.443646:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833966.443658:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833966.443662:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833966.443671:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833966.443679:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833966.443685:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787833966.443687:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787833966.443690:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787833966.443734:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833966.443741:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833966.443786:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833966.443794:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b6c00/0x996d2fb20dc1d35d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833966.443806:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833966.443808:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833966.443810:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833966.443996:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406169216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833966.444058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833966.444128:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406169216 00000100:00100000:3.0:1787833966.444134:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406169216 00000100:00100000:3.0:1787833966.444372:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833966.444380:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1874679406169216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787833966.444386:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787833966 with bad export cookie 11055545102045924893 00010000:00010000:0.0:1787833966.445964:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.445979:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.445986:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.445994:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446015:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787833966.446032:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446040:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446046:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446052:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446064:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787833966.446070:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446076:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446082:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446088:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446100:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787833966.446105:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446112:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446125:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446131:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833966.446138:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787833966.446141:0:15353:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1787833966.447030:0:15353:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787833966.447036:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787833966.447042:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787833966.447048:0:15353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787833966.447055:0:15353:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8df5038af800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787833966.447060:0:15353:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8df502520000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787833966.447064:0:15353:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8df634433490) has exports, disconnecting them 00000020:00080000:0.0:1787833966.447069:0:15353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8df5038af800), last request at 1787833964 00000020:00000080:0.0:1787833966.447076:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d1ff 00000100:00080000:0.0:1787833966.447093:0:15353:0:(import.c:65:import_set_state_nolock()) ffff8df5038ae800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787833966.447140:0:15353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df5038af800): rc 0 00000020:00000080:0.0:1787833966.447143:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df5038af800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787833966.447153:0:15353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8df502520000), last request at 1787833964 00000020:00000080:0.0:1787833966.447156:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d0d9 00000100:00080000:0.0:1787833966.447161:0:15353:0:(import.c:65:import_set_state_nolock()) ffff8df502526000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787833966.447565:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787833966.447574:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.447584:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833966.447587:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.447596:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833966.447603:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833966.447623:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787833966.447626:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1787833966.447628:0:7455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1787833966.447663:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.447669:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833966.447693:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.447699:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df63b246c00/0x996d2fb20dc1d36b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.447712:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787833966.447715:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787833966.447806:0:15353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df502520000): rc 0 00000020:00000080:0.0:1787833966.447810:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df502520000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787833966.447817:0:15353:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9fc9c166fae0 00010000:00010000:2.0:1787833966.448387:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833966.448393:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448402:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787833966.448404:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:2.0:1787833966.448409:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833966.448413:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787833966.448416:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:0.0:1787833966.448416:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 10000000:01000000:2.0:1787833966.448418:0:7455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787833966.448441:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448447:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833966.448455:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448462:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6013fc200/0x996d2fb20dc1d237 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d23e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448475:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787833966.448479:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448484:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833966.448487:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448494:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833966.448501:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833966.448506:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787833966.448508:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787833966.448510:0:7455:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787833966.448519:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448524:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833966.448540:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448551:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b6200/0x996d2fb20dc1d5d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1d5da expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448560:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833966.448563:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448569:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fd000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787833966.448572:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448580:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833966.448586:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833966.448591:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787833966.448593:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787833966.448595:0:7455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787833966.448605:0:7455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448621:0:7455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833966.448627:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448633:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6013fd000/0x996d2fb20dc1cf20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1cf27 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833966.448655:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833966.448657:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833966.448659:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833966.448665:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833966.448681:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406169472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833966.448744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833966.448812:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833966.448818:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406169344:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1787833966.449671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5038af800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1787833966.449729:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502520000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787833966.449761:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5038ae800 for lustre-MDT0001 00000020:00000080:1.0:1787833966.449766:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502526000 for lustre-MDT0001 00000100:00100000:1.0:1787833966.451073:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406169472 00000100:00100000:1.0:1787833966.451086:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406169472 00000100:00100000:1.0:1787833966.451134:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787833966.451142:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874679406169472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787833966.451149:0:8457:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787833966 with bad export cookie 11055545102045924893 00000100:00100000:1.0:1787833966.451236:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874679406169472:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (2490us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787833966.451245:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787833966.451356:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406169600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833966.451395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833966.451447:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833966.451453:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406169728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833966.451476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833966.451498:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406169600 00000100:00100000:1.0:1787833966.451501:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406169600 00000100:00100000:1.0:1787833966.451514:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406169728 00000100:00100000:1.0:1787833966.451516:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406169728 00000100:00100000:1.0:1787833966.451526:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787833966.451530:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874679406169600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787833966.451534:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787833966 with bad export cookie 11055545102045924893 00000100:00100000:1.0:1787833966.451564:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874679406169600:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (169us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787833966.451570:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787833966.451581:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787833966.451584:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874679406169728:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787833966.451587:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787833966 with bad export cookie 11055545102045924893 00000100:00100000:1.0:1787833966.451610:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874679406169728:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (133us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787833966.451614:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787833966.451641:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.117@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787833966.451645:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8df632a25800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787833966.451649:0:3638:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787833966.452528:0:15353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787833966.452536:0:15353:0:(import.c:65:import_set_state_nolock()) ffff8df63b3dc000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1787833966.454334:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787833966.476919:0:3638:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.117@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787833966.476924:0:3638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787833966.476933:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df5046012c0 x1874679406168192/t0(0) o400->MGC192.168.203.117@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787833980 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833966.476947:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df502ec6940 x1874679406169216/t0(0) o103->MGC192.168.203.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787833982 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833966.476971:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fc000 x1874679406169472/t0(0) o103->MGC192.168.203.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787833982 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833966.476980:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212ff480 x1874679406169344/t0(0) o103->MGC192.168.203.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833966.476988:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fe940 x1874679406169600/t0(0) o103->MGC192.168.203.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787833982 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833966.476997:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fda40 x1874679406169728/t0(0) o103->MGC192.168.203.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787833982 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787833966.477005:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787833966.477007:0:3638:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787833966.477013:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787833966.477217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833966.477383:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406169472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833966.477417:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406169344 00000100:00100000:2.0:1787833966.477425:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406169344 00000100:00100000:2.0:1787833966.477463:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787833966.477469:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1874679406169344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787833966.477476:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787833966 with bad export cookie 11055545102045924893 00000100:00100000:2.0:1787833966.477523:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1874679406169344:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (306us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787833966.477530:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787833966.477560:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.117@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787833966.477563:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8df632a25800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787833966.477573:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3f2e78c7-534c-47b7-a20f-32c44fb24136:3641:1874679406169344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833966.477839:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3f2e78c7-534c-47b7-a20f-32c44fb24136:3639:1874679406169216:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787833966.482132:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787833966.482140:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787833966.482658:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787833966.482766:0:15353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787833966.482793:0:15353:0:(import.c:65:import_set_state_nolock()) ffff8df5027bc000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787833966.482815:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787833966.482818:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787833966.483060:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787833966.483138:0:15353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787833966.483150:0:15353:0:(import.c:65:import_set_state_nolock()) ffff8df503c55000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787833966.483675:0:15353:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8df634433490) has no exports 00000100:00080000:1.0:1787833966.483976:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8df632a25800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787833966.483984:0:3638:0:(import.c:510:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 168 00000100:00080000:1.0:1787833966.483993:0:3638:0:(import.c:624:import_select_connection()) MGC192.168.203.117@tcp: import ffff8df632a25800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787833966.484109:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a9b840 x1874679406170112/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787833966.484140:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406169600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787833966.484149:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406168192:0@lo:400:kworker.0 00000100:00100000:0.0:1787833966.484246:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3f2e78c7-534c-47b7-a20f-32c44fb24136:3638:1874679406169728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833966.493494:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406169856:0@lo:9:umount.0 00000100:00100000:3.0:1787833966.493569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833966.494428:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406169984:0@lo:9:umount.0 00000100:00100000:3.0:1787833966.494469:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833966.494511:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3f2e78c7-534c-47b7-a20f-32c44fb24136:3637:1874679406170112:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:1.0:1787833966.494523:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406169856 00000400:00000100:3.0:1787833966.494529:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874679406170112 offset 0 length 520: 4 00000100:00100000:1.0:1787833966.494530:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406169856 00000100:00100000:1.0:1787833966.494591:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406169984 00000100:00100000:1.0:1787833966.494595:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406169984 00000100:00100000:1.0:1787833966.494631:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787833966.494641:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874679406169856:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787833966.494666:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d134 00000100:00080000:1.0:1787833966.494674:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8df502521000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787833966.494712:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787833966.494898:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3637:x1874679406169856:12345-0@lo:9:umount.0 Request processed in 258us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833966.494907:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787833966.494922:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787833966.494928:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874679406169984:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787833966.494953:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d268 00000100:00080000:1.0:1787833966.494958:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8df5038ab000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1787833966.494966:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833966.494971:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1787833966.494978:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787833966.495050:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3637:x1874679406169984:12345-0@lo:9:umount.0 Request processed in 122us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833966.495056:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1787833966.495248:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833966.495324:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1787833966.495768:0:6500:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874679406169216 offset 224 length 224: 4 00000100:00100000:3.0:1787833966.495788:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1874679406169216:12345-0@lo:103:ldlm_bl.0 Request processed in 51406us (51728us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787833966.495797:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787833966.495857:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df5027bc000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787833966.495971:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787833966.496069:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787833966.496074:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406169856:0@lo:9:umount.0 00000100:00080000:2.0:1787833966.496089:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df503c55000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787833966.496099:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787833966.496100:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787833966.496103:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406169984:0@lo:9:umount.0 00000020:00080000:1.0:1787833966.508130:0:15353:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8df634433490) has no exports 00000020:01000000:0.0:1787833966.560402:0:15353:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df502ecf8a0 - data ffff8df5028a7e58/ffff8df63b2c8000 00000020:01000000:0.0:1787833966.560644:0:15353:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df60ed18660 - data ffff8df62ee27e58/ffff8df63c372800 00000001:00000004:2.0:1787833966.579862:0:15353:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1787833966.655734:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787833966.655743:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787833966.655770:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787833966.657161:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787833966.657167:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1787833966.657177:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787833966.657179:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787833966.657515:0:8575:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787833966.657524:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1787833966.657561:0:8575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787833966.659113:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787833966.659119:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1787833966.659165:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787833966.659178:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787833966.659406:0:9980:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787833966.659410:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1787833966.659419:0:9980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787833966.660550:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cf43 00000020:00000080:3.0:1787833966.660560:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63b3d8000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787833966.662472:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cf58 00000020:00000080:3.0:1787833966.662484:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63b3dd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787833966.662535:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b3d8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787833966.662668:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787833966.662674:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833966.662681:0:15353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787833966.662684:0:15353:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8df60efc8000) has no exports 00000004:01000000:3.0:1787833966.663021:0:15353:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787833966.663030:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d261 00000020:00000080:3.0:1787833966.663036:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df503c57000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787833966.663073:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b3dd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787833966.663202:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787833966.663207:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833966.663215:0:15353:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787833966.663218:0:15353:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8df503f10000) has no exports 00000020:00000080:3.0:1787833966.663224:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d25a 00000020:00000080:3.0:1787833966.663229:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df503c50000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787833966.663247:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503c57000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1787833966.663630:0:15353:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787833966.663636:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787833966.663640:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787833966.663646:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787833966.663648:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787833966.663940:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503c50000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787833966.664046:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833966.664057:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787833966.664063:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d11f 00000020:00000080:3.0:1787833966.664069:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df5027bf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787833966.664095:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df503c55000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787833966.664101:0:36:0:(genops.c:885:class_export_put()) final put ffff8df503c54800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787833966.664103:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503c54800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787833966.664107:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787833966.664235:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787833966.664239:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833966.664244:0:15353:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787833966.664247:0:15353:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8df635863490) has no exports 00000020:00000080:3.0:1787833966.664252:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d118 00000020:00000080:3.0:1787833966.664256:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df5027bc800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787833966.664284:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5027bf000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1787833966.664668:0:15353:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787833966.664672:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787833966.664675:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787833966.664679:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787833966.664680:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787833966.665219:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5027bc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787833966.665318:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833966.665326:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787833966.665338:0:15353:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787833966.665345:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cf7b 00000020:00000080:3.0:1787833966.665351:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63b3dc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787833966.665530:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5027bc000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787833966.665550:0:36:0:(genops.c:885:class_export_put()) final put ffff8df5027be000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787833966.665552:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5027be000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787833966.665557:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787833966.665701:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787833966.665706:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833966.665711:0:15353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787833966.665714:0:15353:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8df634434ed8) has no exports 00000020:00000080:3.0:1787833966.665720:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cf74 00000020:00000080:3.0:1787833966.665724:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63b3da000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787833966.665974:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b3dc800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787833966.665980:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b3da000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787833966.686196:0:15353:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1787833966.686205:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787833966.686210:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1787833966.686219:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787833966.686318:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833966.686330:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787833966.686362:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833966.686366:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787833966.686371:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df634372000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787833966.686375:0:15353:0:(genops.c:844:class_export_destroy()) destroying export ffff8df634372000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787833966.686394:0:15353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787833966.686501:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df63b3dc000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787833966.686511:0:36:0:(genops.c:885:class_export_put()) final put ffff8df63b3d8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787833966.686513:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b3d8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1787833966.686524:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787833966.686746:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cf5f 00000020:00000080:3.0:1787833966.686769:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63b3db800/lustre-MDD0001_UUID 00000020:01000000:3.0:1787833966.686778:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1787833966.686783:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833966.686797:0:15353:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787833966.686801:0:15353:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8df634430000) has no exports 00000020:00000080:3.0:1787833966.686821:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833966.686824:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787833966.686829:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cf66 00000020:00000080:3.0:1787833966.686833:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63b3da800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1787833966.686841:0:15353:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63b1db800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1787833966.686844:0:15353:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63b1db800 2 00000020:01000004:3.0:1787833966.686848:0:15353:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df63b1db800 from lustre-MDT0001 00000020:00000080:3.0:1787833966.686863:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833966.686876:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1787833966.686879:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63b3db000/lustre-MDT0001_UUID 00000020:00000080:3.0:1787833966.686881:0:15353:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b3db000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1787833966.686888:0:15353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1787833966.686927:0:15353:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1787833966.686931:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1787833966.686934:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833966.686937:0:15353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787833966.686943:0:15353:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8df63c3b9000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787833966.686947:0:15353:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8df62ea91a48) has exports, disconnecting them 00000020:00080000:3.0:1787833966.686951:0:15353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8df63c3b9000), last request at 1787833714 00000020:00000080:3.0:1787833966.686954:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cfba 00000020:00080000:3.0:1787833966.686960:0:15353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df63c3b9000): rc 0 00000020:00000080:3.0:1787833966.686963:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63c3b9000/lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787833966.687504:0:15353:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787833966.687509:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787833966.687512:0:15353:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787833966.687516:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787833966.687694:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833966.687700:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787833966.687704:0:15353:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63b1db800 1 00000020:00000080:3.0:1787833966.687716:0:15353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1cef6 00000020:00000080:3.0:1787833966.687720:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63b1dc000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787833966.688202:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b3db800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787833966.688208:0:36:0:(genops.c:885:class_export_put()) final put ffff8df63b3dd000/lustre-MDD0001_UUID 00000020:00000080:1.0:1787833966.688210:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b3dd000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787833966.688222:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787833966.688588:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b3da800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787833966.688595:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c3b9000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787833966.688599:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df634359000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787833966.688605:0:36:0:(genops.c:885:class_export_put()) final put ffff8df63b15f000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787833966.688607:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b15f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787833966.688611:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:3.0:1787833966.689068:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787833966.689074:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833966.689080:0:15353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787833966.689084:0:15353:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8df60efcb490) has no exports 00000020:00000080:1.0:1787833966.691522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b1dc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787833966.914399:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833966.914414:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787833966.914419:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df63b1dd800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787833966.914423:0:15353:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b1dd800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787833966.914434:0:15353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787833966.914700:0:15353:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df63b1d9800 00000020:01000000:2.0:1787833966.914721:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787833966.914725:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833966.914729:0:15353:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787833966.914733:0:15353:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8df60ec70000) has no exports 00000100:00100000:0.0:1787833966.914904:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8df602e84800:6514] 1 exiting: rc = 0 00000100:00100000:0.0:1787833966.915004:0:9772:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8df63c1ad400:9772] 3 exiting: rc = 0 00000100:00100000:0.0:1787833966.915080:0:6515:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8df602e84a00:6515] 2 exiting: rc = 0 00000100:00100000:3.0:1787833966.915167:0:13407:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8df503efaa00:13407] 4 exiting: rc = 0 00000100:00100000:1.0:1787833966.915262:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8df6030aae00:6513] 0 exiting: rc = 1 00000100:00100000:0.0:1787833966.915347:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915357:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915367:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915376:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915384:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915393:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915403:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915420:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915426:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915430:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915436:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915451:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915458:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915464:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915469:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915475:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915482:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915488:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915494:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915500:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915506:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915512:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915518:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915524:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915530:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915536:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915543:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915548:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915555:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915561:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915569:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915574:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915589:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915595:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915601:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915606:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915612:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915617:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915621:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915627:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915632:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915637:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915650:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915656:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915661:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915667:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915672:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915677:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915683:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915689:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915694:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915699:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915703:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915709:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915714:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915719:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915724:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915729:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915734:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915739:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915744:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915774:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915782:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.915787:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833966.918217:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8df60ec53e00:6516] 0 exiting: rc = 1 00000100:00100000:2.0:1787833966.918405:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8df60ec53a00:6517] 1 exiting: rc = 0 00000100:00100000:0.0:1787833966.919407:0:14752:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8df602597800:14752] 2 exiting: rc = 0 00000100:00100000:3.0:1787833966.925371:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925381:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925388:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925395:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925402:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925407:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925413:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925419:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925426:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925498:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925506:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925513:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925520:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925524:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925529:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925534:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925539:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925544:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925550:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925555:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925560:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925564:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925568:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925573:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925578:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925583:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925589:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925594:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925618:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925623:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925629:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925634:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925638:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925643:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925648:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925652:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925657:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925663:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925667:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925671:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925676:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925682:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925687:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925692:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925697:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925703:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925707:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925713:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925804:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925810:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925815:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925820:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925825:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925830:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925835:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925840:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925845:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925850:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925855:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925859:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925864:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925882:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.925887:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.926318:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833966.928663:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8df605a76400:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1787833966.928845:0:7823:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8df63c1f3c00:7823] 2 exiting: rc = 0 00000100:00100000:0.0:1787833966.929127:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8df605a77800:6520] 1 exiting: rc = 0 00000100:00100000:3.0:1787833966.933396:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933407:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933415:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933420:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933438:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933444:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933450:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933456:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933462:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933468:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933473:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933479:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933503:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933509:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933514:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933520:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933525:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933530:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933536:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933541:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933547:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933553:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933559:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933564:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933585:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933592:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933598:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933603:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933609:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933614:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933619:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933625:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933633:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933639:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933661:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933668:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933687:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933695:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933703:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933710:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933724:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933730:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933735:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933741:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933747:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933772:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933782:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933789:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933795:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933809:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933831:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933838:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933846:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933853:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933860:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933873:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933880:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933885:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933890:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933917:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933925:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933932:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933938:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.933951:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.946879:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8df620748a00:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1787833966.946886:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8df605a76000:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1787833966.947140:0:9982:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0002: service thread [ffff8df503973600:9982] 2 exiting: rc = 0 00000100:00100000:2.0:1787833966.947261:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947268:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947274:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947279:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947284:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947289:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947294:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947299:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947304:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947316:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947322:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947327:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947333:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947338:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947343:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947348:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947353:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947358:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947363:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947368:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947372:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947377:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947382:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947386:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947391:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947396:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947401:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947406:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947411:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947416:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947421:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947426:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947443:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947448:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947454:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947459:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947464:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947470:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947475:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947480:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947485:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947489:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947495:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947500:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947513:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947518:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947523:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947527:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947532:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947536:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947541:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947546:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947550:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947556:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947561:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947566:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947571:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947576:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947582:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947587:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947592:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947597:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947601:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.947606:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833966.948392:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8df605a77e00:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1787833966.952773:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8df605a77000:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1787833966.952933:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952940:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952946:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952950:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952956:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952960:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952965:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952970:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952974:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952979:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952983:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952988:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952992:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.952996:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953001:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953023:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953029:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953034:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953039:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953043:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953047:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953052:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953057:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953061:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953065:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953070:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953074:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953078:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953083:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953087:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953092:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953096:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953100:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953105:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953110:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953115:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953119:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953124:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953129:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953133:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953137:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953142:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953146:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953151:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953155:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953160:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953165:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953170:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953175:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953179:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953192:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953197:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953201:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953206:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953211:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953216:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953221:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953226:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953230:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953235:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953239:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953243:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953248:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.953252:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833966.953729:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8df605a76800:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1787833966.953936:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8df60e120a00:6526] 1 exiting: rc = 0 00000100:00100000:2.0:1787833966.954251:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954257:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954262:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954267:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954273:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954278:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954283:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954287:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954293:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954298:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954302:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954307:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954312:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954318:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954323:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954327:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954332:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954338:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954342:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954348:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954353:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954368:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954372:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954378:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954383:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954387:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954391:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954396:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954401:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954406:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954411:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954416:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954421:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954426:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954496:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954502:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954507:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954513:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954518:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954524:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954528:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954533:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954538:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954543:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954548:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954553:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954558:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954562:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954567:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954572:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954576:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954581:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954585:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954590:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954595:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954600:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954612:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954616:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954621:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954625:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954630:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954634:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954639:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.954645:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833966.955403:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8df60e1d4400:6529] 2 exiting: rc = 0 00000100:00100000:0.0:1787833966.955815:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8df60e1d5c00:6527] 0 exiting: rc = 1 00000100:00100000:3.0:1787833966.956138:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8df60e1d4200:6528] 1 exiting: rc = 0 00000100:00100000:3.0:1787833966.961438:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961448:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961464:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961470:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961476:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961481:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961487:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961492:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961498:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961503:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961509:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961514:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961520:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961525:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961531:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961536:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961541:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961547:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961553:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961569:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961574:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961581:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961586:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961592:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961598:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961603:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961609:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961614:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961620:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961625:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961631:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961636:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961641:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961647:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961652:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961658:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961663:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961674:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961680:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961686:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961691:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961698:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961704:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961732:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961739:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961744:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961766:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961772:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961777:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961782:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961788:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961794:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961799:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961804:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961810:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961815:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961820:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961826:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961832:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961837:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961842:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961847:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961852:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833966.961874:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787833966.969474:0:15353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833966.969486:0:15353:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787833966.969491:0:15353:0:(genops.c:885:class_export_put()) final put ffff8df632a24000/MDS_uuid 00000020:00000080:3.0:1787833966.969496:0:15353:0:(genops.c:844:class_export_destroy()) destroying export ffff8df632a24000/MDS_uuid for MDS 00000020:01000000:3.0:1787833966.969502:0:15353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787833966.969647:0:15353:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787833967.381983:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833968.405980:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833969.431688:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787833969.493979:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833969.493988:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787833969.493991:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833969.493994:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787833969.493998:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df62ea25800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833969.494005:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 440 00000100:00080000:2.0:1787833969.494011:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787833969.494018:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df62ea25800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833969.494052:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212fcb40 x1874679406170240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787833969.494103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833969.494107:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787833969.494108:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833969.494112:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 440 00000100:00080000:2.0:1787833969.494115:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787833969.494119:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df5039c4000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833969.494129:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212fc000 x1874679406170496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787833969.494188:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406170624:0@lo:400:kworker.0 00000400:00000100:2.0:1787833969.494235:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406170624 offset 0 length 224: 4 00000100:00100000:2.0:1787833969.494291:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833969.494297:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406170368:0@lo:400:kworker.0 00000400:00000100:2.0:1787833969.494314:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406170368 offset 0 length 224: 4 00000100:00100000:0.0:1787833969.494501:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406170240:0@lo:38:kworker.0 00000400:00000100:0.0:1787833969.494524:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406170240 offset 0 length 520: 4 00000100:00100000:0.0:1787833969.494538:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406170496:0@lo:38:kworker.0 00000400:00000100:0.0:1787833969.494552:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406170496 offset 0 length 520: 4 00010000:00010000:3.0:1787833970.454867:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787833970.740694:0:15553:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787833970.750955:0:15553:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787833970.751015:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833970.751031:0:15553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833970.751040:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833970.751048:0:15553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833970.751076:0:15553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787833970.751081:0:15553:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787833970.751108:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787833970.751119:0:15553:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fcb40 x1874679406170240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787833989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833970.751138:0:15553:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787833970.751143:0:15553:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787833970.751149:0:15553:0:(import.c:65:import_set_state_nolock()) ffff8df62ea25800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787833970.751154:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787833970.751158:0:15553:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fcb40 x1874679406170240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787833989 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833970.751165:0:15553:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787833970.751168:0:15553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:0.0:1787833970.751922:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406170240:0@lo:38:kworker.0 00010000:00010000:3.0:1787833970.753284:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833970.753299:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833970.753308:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833970.753312:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833970.753321:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833970.753328:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833970.753333:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787833970.753336:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787833970.753339:0:7455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787833970.753356:0:7455:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df632a25800 00010000:00010000:3.0:1787833970.753359:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833970.753366:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1d341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d348 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833970.753380:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833970.753382:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833970.753384:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787833970.761318:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787833970.761336:0:15553:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212ff480 x1874679406170368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833985 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833970.761362:0:15553:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787833970.761367:0:15553:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787833970.761392:0:15553:0:(import.c:65:import_set_state_nolock()) ffff8df502d1a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787833970.761476:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406170752:0@lo:39:umount.0 00000400:00000100:0.0:1787833970.761528:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406170752 offset 0 length 224: 4 00000100:00100000:1.0:1787833970.761901:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406170368:0@lo:400:kworker.0 00010000:00010000:2.0:1787833971.483408:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787833971.541975:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787833971.541984:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787833971.541987:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787833971.541991:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787833971.542119:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406170880:0@lo:400:kworker.0 00000400:00000100:1.0:1787833971.542188:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406170880 offset 0 length 224: 4 00000001:00100000:3.0:1787833972.059557:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787833972.059566:0:9510:0:(genops.c:885:class_export_put()) final put ffff8df5038ad000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787833972.060060:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5038ad000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787833972.060107:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5038ab000 for lustre-OST0001 00000001:00100000:1.0:1787833972.060316:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787833972.060320:0:8424:0:(genops.c:885:class_export_put()) final put ffff8df502523800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787833972.063449:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502523800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787833972.067313:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502521000 for lustre-OST0000 00010000:00010000:3.0:1787833972.502024:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833973.525955:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787833974.550602:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833974.550611:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787833974.550614:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833974.550616:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787833974.550742:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833974.550787:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406171008:0@lo:400:kworker.0 00000400:00000100:1.0:1787833974.550847:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406171008 offset 0 length 224: 4 00010000:00010000:3.0:1787833974.550990:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833975.573991:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833976.598026:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833976.917946:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787833966/real 1787833966] req@ffff8df635a9b840 x1874679406170112/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787833976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833976.917978:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df635a9b840 x1874679406170112/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787833976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787833976.917999:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df632a25800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787833976.918025:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787833976.918029:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3f2e78c7-534c-47b7-a20f-32c44fb24136:3637:1874679406170112:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1787833976.918134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833976.918140:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787833976.918143:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df632a25800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833976.918148:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 442 00000100:00080000:2.0:1787833976.918153:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.117@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787833976.918176:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.117@tcp: import ffff8df632a25800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833976.918204:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212fda40 x1874679406171136/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787833976.918231:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833976.918235:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787833976.918342:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833976.918356:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406171264:0@lo:400:kworker.0 00000400:00000100:3.0:1787833976.918414:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406171264 offset 0 length 224: 4 00000100:00100000:0.0:1787833976.918604:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3f2e78c7-534c-47b7-a20f-32c44fb24136:3637:1874679406171136:0@lo:250:kworker.0 00000400:00000100:0.0:1787833976.918629:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874679406171136 offset 0 length 520: 4 00010000:00010000:3.0:1787833977.622449:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833978.646121:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833979.669934:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833980.694139:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833981.013897:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787833970/real 1787833970] req@ffff8df6212fcb40 x1874679406170752/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787833980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833981.013933:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df6212fcb40 x1874679406170752/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787833980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787833981.013973:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502d1a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787833981.014065:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406170752:0@lo:39:umount.0 00000100:00080000:2.0:1787833981.015996:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787833981.016004:0:15553:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787833981.016011:0:15553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787833981.017466:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833981.017484:0:15553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833981.017492:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833981.017500:0:15553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833981.017653:0:15553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833981.017663:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833981.017670:0:15553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833981.017676:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833981.017696:0:15553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833981.018491:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833981.018503:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833981.018512:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833981.018517:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833981.018527:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833981.018534:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833981.018540:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787833981.018543:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1787833981.018557:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df632a25800 00010000:00010000:3.0:1787833981.018561:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833981.018567:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1d34f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833981.018593:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833981.018598:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833981.018604:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833981.018606:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833981.018684:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833981.018690:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833981.018695:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787833981.018849:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787833981.018855:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df632a25800 00010000:00010000:3.0:1787833981.018859:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833981.018867:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833981.018869:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833981.018871:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833981.019343:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833981.019428:0:15553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787833981.019435:0:15553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1d5c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d5cc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833981.019448:0:15553:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1787833981.019454:0:15553:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1787833981.019456:0:15553:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787833981.019488:0:15553:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787833981.019492:0:15553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787833981.019499:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833981.019505:0:15553:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787833981.019509:0:15553:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8df634431a48) has no exports 00000020:00080000:2.0:1787833981.019532:0:15553:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8df634431a48) has no exports 00000020:01000000:2.0:1787833981.024123:0:15553:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df50277b480 - data ffff8df62ef2a288/ffff8df503ec4400 00000020:01000000:2.0:1787833981.024313:0:15553:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df502672120 - data ffff8df62edb7ca8/ffff8df502530400 00100000:10000000:2.0:1787833981.045290:0:15553:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787833981.065503:0:15553:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d093 00000020:00000080:0.0:1787833981.065517:0:15553:0:(genops.c:885:class_export_put()) final put ffff8df502522800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787833981.065543:0:15553:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df6359b9000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787833981.065547:0:15553:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df6359b9000 2 00000020:01000004:0.0:1787833981.065550:0:15553:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df6359b9000 from lustre-OST0000 00000020:00000080:0.0:1787833981.065572:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787833981.065583:0:15553:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787833981.065585:0:15553:0:(genops.c:885:class_export_put()) final put ffff8df502522000/lustre-OST0000_UUID 00000020:00000080:0.0:1787833981.065588:0:15553:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502522000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787833981.065595:0:15553:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787833981.065660:0:15553:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787833981.065665:0:15553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787833981.065670:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787833981.065675:0:15553:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787833981.065682:0:15553:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8df63b158800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787833981.065687:0:15553:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8df5027c1a48) has exports, disconnecting them 00000020:00080000:0.0:1787833981.065692:0:15553:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8df63b158800), last request at 1787833738 00000020:00000080:0.0:1787833981.065697:0:15553:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d0bd 00000020:00080000:0.0:1787833981.065705:0:15553:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df63b158800): rc 0 00000020:00000080:0.0:1787833981.065710:0:15553:0:(genops.c:885:class_export_put()) final put ffff8df63b158800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787833981.065863:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502522800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787833981.065872:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b158800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787833981.067954:0:15553:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787833981.067962:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787833981.067967:0:15553:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787833981.067972:0:15553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787833981.068117:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df62ea25800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787833981.068302:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787833981.068320:0:15553:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787833981.068326:0:15553:0:(genops.c:885:class_export_put()) final put ffff8df63b159000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787833981.068330:0:15553:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b159000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787833981.068337:0:15553:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787833981.068394:0:15553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787833981.068398:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787833981.068403:0:15553:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787833981.068409:0:15553:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8df5027be800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787833981.068415:0:15553:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8df5027c3490) has exports, disconnecting them 00000020:00080000:0.0:1787833981.068420:0:15553:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8df5027be800), last request at 1787833738 00000020:00000080:0.0:1787833981.068424:0:15553:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d0d2 00000020:00080000:0.0:1787833981.068436:0:15553:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df5027be800): rc 0 00000020:00000080:0.0:1787833981.068441:0:15553:0:(genops.c:885:class_export_put()) final put ffff8df5027be800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787833981.068725:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5027be800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787833981.100543:0:15553:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787833981.100551:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787833981.100556:0:15553:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787833981.100563:0:15553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787833981.100985:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787833981.100995:0:15553:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787833981.101002:0:15553:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df6359b9000 1 00000020:00000080:0.0:1787833981.101009:0:15553:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d05b 00000020:00000080:0.0:1787833981.101017:0:15553:0:(genops.c:885:class_export_put()) final put ffff8df63c3bd000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787833981.101024:0:15553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787833981.101029:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787833981.101034:0:15553:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787833981.101038:0:15553:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8df60ef49a48) has no exports 00000020:00000080:3.0:1787833981.102689:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502d1a000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787833981.102704:0:36:0:(genops.c:885:class_export_put()) final put ffff8df63b15b000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787833981.102707:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63b15b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787833981.102720:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787833981.102819:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c3bd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787833981.151200:0:15553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833981.151213:0:15553:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787833981.151218:0:15553:0:(genops.c:885:class_export_put()) final put ffff8df6359be000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787833981.151222:0:15553:0:(genops.c:844:class_export_destroy()) destroying export ffff8df6359be000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787833981.151232:0:15553:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787833981.151339:0:15553:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df6359b8000 00000020:02000400:3.0:1787833981.151382:0:15553:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787833981.719727:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787833982.295924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833982.295934:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787833982.295937:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833982.295940:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787833982.296034:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833982.303071:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406171392:0@lo:400:kworker.0 00000400:00000100:0.0:1787833982.303134:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406171392 offset 0 length 224: 4 00010000:00010000:3.0:1787833982.744518:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833983.768281:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833984.806958:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787833985.046821:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787833969/real 1787833969] req@ffff8df6212fe1c0 x1874679406170624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787833985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833985.094733:0:3641:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8df6212fe1c0 x1874679406170624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787833985 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787833985.094793:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8df503db1800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787833985.094797:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787833985.128866:0:3641:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1787833985.132801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833985.132809:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787833985.132812:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833985.132828:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787833985.132830:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787833985.132833:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787833985.132837:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df503db1800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833985.132845:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 241 00000100:00080000:2.0:1787833985.132854:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8df503db1800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787833985.132892:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212fc3c0 x1874679406171520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787833985.132947:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406171520:0@lo:38:kworker.0 00000400:00000100:2.0:1787833985.132998:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406171520 offset 0 length 520: 4 00000100:00100000:1.0:1787833985.134550:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406170624:0@lo:400:kworker.0 00010000:00010000:3.0:1787833985.815044:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787833985.832080:0:15755:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787833985.850429:0:15755:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787833985.850509:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.850524:0:15755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.850532:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.850540:0:15755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.850697:0:15755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787833985.850703:0:15755:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787833985.850727:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787833985.850796:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fc000 x1874679406170496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787833989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.850829:0:15755:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787833985.850863:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787833985.850877:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1787833985.850880:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406170496:0@lo:38:kworker.0 00000100:00080000:2.0:1787833985.850908:0:15755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787833985.850913:0:15755:0:(import.c:65:import_set_state_nolock()) ffff8df5039c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787833985.850918:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787833985.850920:0:15755:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787833985.850923:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787833985.851743:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787833985.851773:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df635a98b40 x1874679406170880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833987 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.851794:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212ff840 x1874679406171008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.851802:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fe940 x1874679406171264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833992 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.851814:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fde00 x1874679406171392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833998 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.851826:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fc3c0 x1874679406171520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787833995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.851836:0:15755:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787833985.851856:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df503db1800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787833985.851860:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1787833985.851863:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406171520:0@lo:38:kworker.0 00000100:00080000:2.0:1787833985.851880:0:15755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787833985.851891:0:15755:0:(import.c:65:import_set_state_nolock()) ffff8df503db1800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787833985.851894:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787833985.851898:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df635a98b40 x1874679406170880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833987 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.851906:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212ff840 x1874679406171008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833990 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.851914:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fe940 x1874679406171264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833992 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.851921:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fde00 x1874679406171392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833998 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833985.851927:0:15755:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787833985.851930:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00080000:0.0:1787833985.852531:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787833985.852537:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787833985.853064:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406171008:0@lo:400:kworker.0 00000100:00100000:1.0:1787833985.853078:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406170880:0@lo:400:kworker.0 00000100:00100000:1.0:1787833985.853110:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406171264:0@lo:400:kworker.0 00000100:00100000:1.0:1787833985.853131:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406171392:0@lo:400:kworker.0 00010000:00010000:2.0:1787833985.858657:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.858676:0:15755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.858683:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.858689:0:15755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833985.859048:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833985.859056:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833985.859063:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833985.859079:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833985.859087:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833985.859094:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833985.859100:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787833985.859102:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787833985.859104:0:7455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787833985.859133:0:7455:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df632a25800 00010000:00010000:3.0:1787833985.859137:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833985.859144:0:7455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1d325 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d32c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833985.860154:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833985.860162:0:7455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833985.860171:0:7455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787833985.860174:0:7455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833985.860181:0:7455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833985.860187:0:7455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833985.860191:0:7455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787833985.860194:0:7455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1787833985.860201:0:7455:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df632a25800 00010000:00010000:0.0:1787833985.860205:0:7455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833985.860213:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833985.860215:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833985.860217:0:7455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833985.860302:0:15755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787833985.860309:0:15755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1d333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d33a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.860322:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.860342:0:15755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.860349:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833985.860355:0:15755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833985.860465:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833985.860470:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833985.860477:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787833985.860480:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833985.860487:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833985.860493:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833985.860505:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787833985.860507:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787833985.860513:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df632a25800 00010000:00010000:3.0:1787833985.860516:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833985.860522:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833985.860524:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833985.860526:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833985.861138:0:15755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787833985.861144:0:15755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b7a00/0x996d2fb20dc1d5b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d5be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833985.861158:0:15755:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1787833985.861162:0:15755:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787833985.861164:0:15755:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787833985.861193:0:15755:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787833985.861197:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787833985.861204:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833985.861209:0:15755:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787833985.861213:0:15755:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8df5039bced8) has no exports 00000020:00080000:2.0:1787833985.861235:0:15755:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8df5039bced8) has no exports 00000020:01000000:2.0:1787833985.863518:0:15755:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df503e7e5a0 - data ffff8df5028a51b0/ffff8df503ebec00 00000020:01000000:2.0:1787833985.864160:0:15755:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df50277b300 - data ffff8df62eeb60d8/ffff8df635b3d000 00010000:00010000:3.0:1787833985.865076:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787833985.878344:0:15755:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787833985.884006:0:15755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d1b9 00000020:00000080:0.0:1787833985.884017:0:15755:0:(genops.c:885:class_export_put()) final put ffff8df5039c6800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787833985.884031:0:15755:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63fb44000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787833985.884035:0:15755:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63fb44000 2 00000020:01000004:0.0:1787833985.884038:0:15755:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df63fb44000 from lustre-OST0001 00000020:00000080:0.0:1787833985.884068:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787833985.884076:0:15755:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787833985.884079:0:15755:0:(genops.c:885:class_export_put()) final put ffff8df635802800/lustre-OST0001_UUID 00000020:00000080:0.0:1787833985.884082:0:15755:0:(genops.c:844:class_export_destroy()) destroying export ffff8df635802800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787833985.884088:0:15755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787833985.884216:0:15755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3f2e78c7-534c-47b7-a20f-32c44fb24136->MGS 00010000:00010000:0.0:1787833985.884229:0:15755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df6013fdc00/0x996d2fb20dc1cf12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1cf19 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833985.884239:0:15755:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df6013fdc00/0x996d2fb20dc1cf12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1cf19 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833985.884245:0:15755:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787833985.884247:0:15755:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787833985.884250:0:15755:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787833985.884268:0:15755:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df632a25800 00010000:00010000:0.0:1787833985.884272:0:15755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df6013fdc00/0x996d2fb20dc1cf12 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1cf19 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833985.884287:0:15755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1d39c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833985.884293:0:15755:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1d39c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833985.884297:0:15755:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787833985.884299:0:15755:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787833985.884301:0:15755:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787833985.884313:0:15755:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df632a25800 00010000:00010000:0.0:1787833985.884316:0:15755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1d395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1d39c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787833985.884339:0:15755:0:(import.c:65:import_set_state_nolock()) ffff8df632a25800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787833985.884342:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787833985.884344:0:15755:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787833985.884345:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787833985.884349:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787833985.884358:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6212fda40 x1874679406171136/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787833991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1787833985.884449:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039c6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1787833985.884724:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787833985.884727:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1787833985.886515:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3f2e78c7-534c-47b7-a20f-32c44fb24136:3637:1874679406171136:0@lo:250:kworker.0 10000000:01000000:3.0:1787833985.888022:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787833985.888037:0:15755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1ce0f 00000020:00000080:3.0:1787833985.888047:0:15755:0:(genops.c:885:class_export_put()) final put ffff8df632a23800/3f2e78c7-534c-47b7-a20f-32c44fb24136 00000020:01000000:3.0:1787833985.888060:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.117@tcp (flags='') 00000020:00000080:3.0:1787833985.888066:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833985.888073:0:15755:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.117@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787833985.888077:0:15755:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8df60ec73490) has no exports 00000020:00000080:0.0:1787833985.888142:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df632a23800/3f2e78c7-534c-47b7-a20f-32c44fb24136 for MGC192.168.203.117@tcp 10000000:01000000:0.0:1787833985.888896:0:6511:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787833985.889225:0:15755:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.117@tcp: client import never connected 00000100:00080000:3.0:1787833985.889230:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787833985.889245:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787833985.889248:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787833985.889250:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787833985.889294:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833985.889302:0:15755:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.117@tcp (uuid 3f2e78c7-534c-47b7-a20f-32c44fb24136) 00000020:01000000:3.0:1787833985.889308:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787833985.889312:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833985.889316:0:15755:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787833985.889323:0:15755:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8df5039c1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787833985.889328:0:15755:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8df5039b9a48) has exports, disconnecting them 00000020:00080000:3.0:1787833985.889901:0:15755:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8df5039c1000), last request at 1787833765 00000020:00000080:3.0:1787833985.889906:0:15755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d1e3 00000020:00080000:3.0:1787833985.889922:0:15755:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df5039c1000): rc 0 00000020:00000080:3.0:1787833985.889927:0:15755:0:(genops.c:885:class_export_put()) final put ffff8df5039c1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787833985.890903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039c1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787833985.891908:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df632a25800 for MGC192.168.203.117@tcp 00000020:00000080:0.0:1787833985.891921:0:8:0:(genops.c:885:class_export_put()) final put ffff8df632a22800/3f2e78c7-534c-47b7-a20f-32c44fb24136 00000020:00000080:0.0:1787833985.891925:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df632a22800/3f2e78c7-534c-47b7-a20f-32c44fb24136 for MGC192.168.203.117@tcp 00000020:01000000:0.0:1787833985.891932:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.117@tcp (3f2e78c7-534c-47b7-a20f-32c44fb24136) 00010000:01000000:0.0:1787833985.917961:0:15755:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787833985.917971:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787833985.917976:0:15755:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787833985.917983:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787833985.918186:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787833985.918195:0:15755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787833985.918200:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787833985.918205:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787833985.918209:0:15755:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787833985.918215:0:15755:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8df503db1000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787833985.918222:0:15755:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8df5039bb490) has exports, disconnecting them 00000020:00080000:0.0:1787833985.918227:0:15755:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8df503db1000), last request at 1787833765 00000020:00000080:0.0:1787833985.918240:0:15755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d1f8 00000020:00080000:0.0:1787833985.918254:0:15755:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df503db1000): rc 0 00000020:00000080:0.0:1787833985.918260:0:15755:0:(genops.c:885:class_export_put()) final put ffff8df503db1000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787833985.918802:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5039c4000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787833985.918810:0:8:0:(genops.c:885:class_export_put()) final put ffff8df5039c2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787833985.918813:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039c2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787833985.918824:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787833985.918891:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503db1000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787833985.928175:0:15755:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787833985.928188:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787833985.928193:0:15755:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787833985.928199:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787833985.928266:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df503db1800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1787833985.930823:0:7455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787833985.932091:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787833985.941057:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787833985.941371:0:9520:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8df503843000:9520] 2 exiting: rc = 0 00000100:00100000:2.0:1787833985.943231:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8df632a86e00:6497] 1 exiting: rc = 0 00000100:00100000:0.0:1787833985.943641:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8df632a86200:6496] 0 exiting: rc = 1 00000100:00100000:1.0:1787833985.943953:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833985.952807:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8df632a80600:6498] 0 exiting: rc = 1 00000100:00100000:2.0:1787833985.952929:0:8457:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8df5024e5c00:8457] 3 exiting: rc = 0 00000100:00100000:2.0:1787833985.953008:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8df60ef8c000:6499] 1 exiting: rc = 0 00000100:00100000:3.0:1787833985.954612:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8df60ef8d800:6500] 2 exiting: rc = 0 00000100:00100000:1.0:1787833985.959853:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959862:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959868:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959874:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959880:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959885:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959891:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959898:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959903:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959908:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959914:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959919:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959925:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959931:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959937:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959956:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959963:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959968:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959974:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959980:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959987:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959992:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.959997:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960002:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960007:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960015:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960021:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960025:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960031:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960036:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960041:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960046:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960064:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960069:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960074:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960079:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960083:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960088:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960093:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960098:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960103:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960108:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960113:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960118:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960123:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960128:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960133:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960138:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960143:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960148:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960153:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960158:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960164:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960171:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960176:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960181:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960186:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960190:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960196:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960200:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960205:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960211:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960216:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833985.960220:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787833985.962242:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787833985.962253:0:15755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787833985.962259:0:15755:0:(genops.c:885:class_export_put()) final put ffff8df5039c7000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787833985.962276:0:15755:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039c7000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787833985.962280:0:15755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787833985.962479:0:15755:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63fb44000 1 00000020:00000080:1.0:1787833985.962485:0:15755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1d188 00000020:00000080:1.0:1787833985.962491:0:15755:0:(genops.c:885:class_export_put()) final put ffff8df63fb43000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787833985.962503:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787833985.962513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63fb43000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787833985.962524:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787833985.962529:0:15755:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787833985.962532:0:15755:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8df5027c4ed8) has no exports 00000020:00000080:1.0:1787833986.179543:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787833986.179556:0:15755:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787833986.179561:0:15755:0:(genops.c:885:class_export_put()) final put ffff8df63fb41800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787833986.179565:0:15755:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63fb41800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787833986.179570:0:15755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787833986.193161:0:15755:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df63fb44800 00000020:01000000:2.0:1787833986.193206:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787833986.193224:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833986.193229:0:15755:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787833986.193233:0:15755:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8df62ea93490) has no exports 00000020:00000080:2.0:1787833986.193263:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833986.193272:0:15755:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787833986.193276:0:15755:0:(genops.c:885:class_export_put()) final put ffff8df63c3bb800/OSS_uuid 00000020:00000080:2.0:1787833986.193279:0:15755:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63c3bb800/OSS_uuid for OSS 00000020:01000000:2.0:1787833986.193290:0:15755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787833986.193406:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8df63b075600:8431] 1 exiting: rc = 0 00000100:00100000:2.0:1787833986.193493:0:8583:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8df50250ec00:8583] 3 exiting: rc = 0 00000100:00100000:3.0:1787833986.193637:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8df63b075800:8432] 2 exiting: rc = 0 00000100:00100000:1.0:1787833986.193776:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8df63b142a00:8430] 0 exiting: rc = 1 00000100:00100000:2.0:1787833986.194222:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194230:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194236:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194250:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194257:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194263:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194268:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194274:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194279:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194284:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194290:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194295:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194299:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194306:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194311:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194315:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194320:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194336:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194341:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194346:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194360:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194365:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194371:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194388:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194392:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194397:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194402:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194412:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194417:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194423:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194427:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194432:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194436:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194441:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194446:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194450:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194455:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194460:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194467:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194473:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194477:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194482:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194487:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194492:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194497:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194504:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194509:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194514:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194519:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194525:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194530:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194535:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194540:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194545:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194549:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194554:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194559:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194564:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194576:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194585:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194591:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194596:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194603:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.194612:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1787833986.195715:0:6509:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787833986.199910:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8df632a87800:8433] 0 exiting: rc = 1 00000100:00100000:1.0:1787833986.200694:0:11278:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8df504498a00:11278] 2 exiting: rc = 0 00000100:00100000:0.0:1787833986.201542:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8df611f21200:8434] 1 exiting: rc = 0 00000100:00100000:3.0:1787833986.201645:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201662:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201669:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201675:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201679:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201684:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201689:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201694:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201699:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201704:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201708:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201713:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201718:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201723:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201728:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201747:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201778:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201783:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201788:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201793:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201799:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201804:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201809:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201814:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201832:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201837:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201843:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201848:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201853:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201858:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201863:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201868:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201873:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201878:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201884:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201889:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201895:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201900:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201905:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201910:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201915:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201920:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201925:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201930:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.201935:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202009:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202017:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202023:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202028:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202033:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202038:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202043:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202048:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202053:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202058:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202064:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202069:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202074:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202079:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202092:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202098:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202104:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202108:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.202114:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833986.204647:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8df63c1be400:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1787833986.205098:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8df63c1bf000:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1787833986.208623:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8df63b179200:8437] 2 exiting: rc = 0 00000100:00100000:3.0:1787833986.214526:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214536:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214541:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214546:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214551:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214557:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214571:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214905:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214911:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214916:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214922:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214927:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214932:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214938:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214954:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214959:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214964:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214970:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214975:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214980:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214985:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214991:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.214996:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215004:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215009:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215014:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215019:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215024:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215030:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215034:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215054:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215074:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215080:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215085:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215091:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215096:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215101:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215107:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215112:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215117:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215122:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215127:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215132:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215137:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215142:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215148:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215153:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215157:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215162:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215167:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215172:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215177:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215182:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215187:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215192:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215208:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215215:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215220:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215225:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215231:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215235:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215241:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215247:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.215260:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833986.230329:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8df63c1c0400:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1787833986.247710:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8df63b10d800:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1787833986.256146:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256156:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256161:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256166:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256171:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256176:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256181:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256186:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256192:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256196:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256202:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256207:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256211:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256217:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256221:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256226:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256232:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256237:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256242:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256247:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256252:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256257:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256263:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256268:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256274:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256279:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256283:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256288:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256308:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256313:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256318:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256323:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256340:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.256346:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258868:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258884:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258889:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258894:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258899:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258903:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258908:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258912:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258916:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258921:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258926:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258930:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258935:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258949:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258955:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258961:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258966:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258971:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258977:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258981:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258986:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258990:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258995:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.258999:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.259004:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.259008:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.259013:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.259017:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.259022:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833986.259041:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833986.266575:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8df63b3f3a00:8441] 1 exiting: rc = 0 00000100:00100000:1.0:1787833986.269905:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8df63c1f6c00:8440] 0 exiting: rc = 1 00000100:00100000:1.0:1787833986.270209:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270215:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270221:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270227:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270232:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270238:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270266:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270274:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270279:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270286:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270292:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270312:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270317:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270323:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270330:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270336:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270341:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270402:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270427:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270435:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270440:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270447:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270453:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270458:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270464:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270470:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270476:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270481:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270486:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270491:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270509:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270516:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270521:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270527:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270533:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270538:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270543:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270549:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270555:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270560:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270565:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270571:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270591:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270598:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270604:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270609:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270621:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270626:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270632:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270637:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270643:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270648:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270653:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270658:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270675:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270681:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270687:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270693:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270698:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270704:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270710:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270716:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270722:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787833986.270745:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787833986.289016:0:15755:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787834005.373619:0:16520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787834016.417342:0:17120:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787834016.417348:0:17120:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787834016.417349:0:17120:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787834016.418260:0:17120:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df504d9f000 00000020:01000004:1.0:1787834016.418283:0:17120:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787834016.418292:0:17120:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787834016.418309:0:17120:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8df635861a48) 00000020:00000080:1.0:1787834016.418323:0:17120:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787834016.501717:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.502845:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787834016.504127:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.506539:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.507537:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.507855:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.508102:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.508305:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.508531:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.508839:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.509097:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.509297:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.509490:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.509729:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.509930:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.510102:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.510282:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.510467:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.510858:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.511084:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.511314:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.511652:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.511861:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.512049:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.512271:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.512494:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.512727:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.513072:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.513296:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.513689:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.513924:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.514114:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787834016.514297:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.514482:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.514840:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787834016.515356:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.515589:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787834016.515931:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787834016.516148:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.516340:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787834016.516657:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.516916:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.517134:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.517421:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787834016.517610:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787834016.517816:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.518045:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787834016.523233:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.525804:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.526588:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.527051:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.527255:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787834016.528244:0:17120:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1787834016.529332:0:17120:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787834016.529561:0:17120:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787834016.529570:0:17120:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787834016.529581:0:17120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1e3cc 00000020:01000004:2.0:1787834016.529589:0:17120:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787834016.529594:0:17120:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787834016.529600:0:17120:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df504d9f000 from MGS 00000020:01000004:2.0:1787834016.529603:0:17120:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787834016.529614:0:17120:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8df60ef4b490) 00000020:00000080:2.0:1787834016.529624:0:17120:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787834016.529686:0:17120:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df504d9f000 from MGS, refs=2 00080000:01000000:2.0:1787834016.529691:0:17120:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787834016.529696:0:17120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1e3da 00000100:00100000:2.0:1787834016.529832:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787834016.529957:0:17120:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787834016.529962:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787834016.531202:0:17120:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787834016.531213:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787834016.532058:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787834016.532227:0:17120:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787834016.532232:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787834016.536067:0:17120:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787834016.536084:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787834016.536606:0:17120:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787834016.536613:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787834016.537396:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834016.537400:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834016.537402:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834016.537744:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834016.537746:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834016.537778:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834016.538312:0:17120:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787834016.540300:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787834016.546797:0:17120:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787834016.547975:0:17132:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787834016.548004:0:17120:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787834016.548036:0:17120:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787834016.549294:0:17120:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787834016.549681:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834016.549962:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787834016.549968:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787834016.552262:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787834016.552275:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787834016.553050:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787834016.553057:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787834016.559073:0:17120:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787834016.560241:0:17120:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.117@tcp' 00000020:01000004:0.0:1787834016.560244:0:17120:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787834016.560275:0:17120:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.117@tcp (typ=mgc) 00000020:00000080:0.0:1787834016.560290:0:17120:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.117@tcp (ffff8df503f10000) 00000020:00000080:0.0:1787834016.560305:0:17120:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787834016.560500:0:17120:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df61e603000@MGC192.168.203.117@tcp: add connection 192.168.203.117@tcp at head 00010000:00010000:0.0:1787834016.560663:0:17120:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.117@tcp-0 is initialized 00000040:01000000:0.0:1787834016.560679:0:17120:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787834016.562744:0:17137:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787834016.574339:0:17138:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787834016.574512:0:17120:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.117@tcp (uuid 1a2d970c-4ae1-4256-8fee-b2c6594a1c06) 00000020:00000080:0.0:1787834016.574546:0:17120:0:(genops.c:1385:class_connect()) connect: client 1a2d970c-4ae1-4256-8fee-b2c6594a1c06, cookie 0x996d2fb20dc1e3e8 00000100:00080000:0.0:1787834016.574558:0:17120:0:(import.c:510:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787834016.574565:0:17120:0:(import.c:624:import_select_connection()) MGC192.168.203.117@tcp: import ffff8df61e603000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834016.574599:0:17120:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a9b840 x1874679406171648/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787834016.574630:0:17120:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS 00000020:01000004:0.0:1787834016.574655:0:17120:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787834016.574660:0:17120:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787834016.574673:0:17120:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8df503f14ed8) 00000020:00000080:0.0:1787834016.574685:0:17120:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787834016.574895:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3637:1874679406171648:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787834016.574971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834016.575040:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406171648 00000100:00100000:2.0:1787834016.575053:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406171648 00000100:00100000:2.0:1787834016.575094:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787834016.575103:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502517850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1874679406171648:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787834016.575127:0:17133:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 1a2d970c-4ae1-4256-8fee-b2c6594a1c06@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1787834016.575147:0:17133:0:(genops.c:1385:class_connect()) connect: client 1a2d970c-4ae1-4256-8fee-b2c6594a1c06, cookie 0x996d2fb20dc1e3f6 00000100:00080000:2.0:1787834016.575295:0:17133:0:(import.c:65:import_set_state_nolock()) ffff8df502eb6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834016.575350:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502517850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+5:3637:x1874679406171648:12345-0@lo:250:mount.lustre.0 Request processed in 246us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834016.575357:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787834016.575403:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787834016.575410:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.117@tcp: connect to target with instance 0 00000100:00080000:2.0:1787834016.575416:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787834016.575420:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787834016.575423:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61e603000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787834016.575426:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787834016.575434:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787834016.575439:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3637:1874679406171648:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787834016.596566:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834016.596745:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787834016.596794:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787834016.599990:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787834016.600007:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787834016.600830:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787834016.600837:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787834016.603896:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834016.604081:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787834016.604258:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787834016.610076:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787834016.610097:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787834016.668724:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787834016.669352:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787834016.669360:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787834016.674536:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787834016.674555:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787834016.675334:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834016.675533:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787834016.675539:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787834016.676238:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787834016.676246:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787834016.677026:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834016.677267:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787834016.677272:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787834016.682899:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787834016.682927:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787834016.683788:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834016.683964:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787834016.683971:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787834016.684747:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787834016.684789:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787834016.718441:0:17120:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787834016.719440:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787834016.719447:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787834016.722848:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787834016.722864:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787834016.724462:0:17120:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787834016.724473:0:17120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787834016.727556:0:17120:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787834016.727784:0:17120:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787834016.727791:0:17120:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787834016.727890:0:17120:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787834016.727931:0:17120:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787834016.727935:0:17120:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787834016.727936:0:17120:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787834016.727938:0:17120:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834016.727939:0:17120:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834016.727940:0:17120:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834016.727942:0:17120:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834016.727943:0:17120:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787834016.727945:0:17120:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787834016.727947:0:17120:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834016.727948:0:17120:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787834016.727951:0:17120:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787834016.727953:0:17120:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787834016.727954:0:17120:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787834016.727955:0:17120:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834016.727957:0:17120:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834016.727958:0:17120:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834016.727959:0:17120:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834016.727960:0:17120:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787834016.727961:0:17120:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787834016.727962:0:17120:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834016.727966:0:17120:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787834016.727992:0:17120:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787834016.728010:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406171776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787834016.728557:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834016.729031:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1300 going to sleep for 11 seconds 00000100:00100000:0.0:1787834016.731680:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406171776 00000100:00100000:0.0:1787834016.731695:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406171776 00000100:00100000:0.0:1787834016.731826:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787834016.731838:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+5:17120:x1874679406171776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787834016.731900:0:17136:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787834016.731903:0:17136:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787834016.731906:0:17136:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787834016.734902:0:17157:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787834016.741172:0:17136:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1787834016.749713:0:17158:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787834016.749726:0:17158:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787834016.749729:0:17158:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787834016.749732:0:17158:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787834016.750561:0:17158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787834016.752747:0:17136:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787834016.752798:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787834016.759583:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+5:17120:x1874679406171776:12345-0@lo:253:mount.lustre.0 Request processed in 27739us (31018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834016.759598:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787834016.759692:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406171776:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787834016.759708:0:17120:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787834016.759711:0:17120:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787834016.759713:0:17120:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787834016.759714:0:17120:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787834016.759715:0:17120:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787834016.759717:0:17120:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787834016.759718:0:17120:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787834016.759719:0:17120:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787834016.759720:0:17120:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787834016.759723:0:17120:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787834016.759724:0:17120:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787834016.759743:0:17120:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df504d9f000 from lustre-MDT0000 10000000:01000000:1.0:1787834016.759945:0:17120:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787834016.759957:0:17120:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787834016.759961:0:17120:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df503f10000 10000000:01000000:1.0:1787834016.759967:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787834016.759975:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df503f10000 from 1 10000000:01000000:1.0:1787834016.759978:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787834016.760014:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.760025:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.760034:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834016.760071:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406171904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834016.760111:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.760195:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834016.760309:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406171904 00000100:00100000:2.0:1787834016.760316:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406171904 00000100:00100000:2.0:1787834016.760396:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787834016.760406:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502514c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+5:17120:x1874679406171904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834016.760426:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834016.760439:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504ccd000/0x996d2fb20dc1e404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e3fd expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834016.760461:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504ccd000/0x996d2fb20dc1e404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e3fd expref: 6 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834016.760472:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504ccd000/0x996d2fb20dc1e404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e3fd expref: 6 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834016.760481:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccd000, rc 0) 00000100:00100000:2.0:1787834016.760526:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502514c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+6:17120:x1874679406171904:12345-0@lo:101:mount.lustre.0 Request processed in 115us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834016.760533:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787834016.760584:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406171904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834016.760596:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.760604:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834016.760671:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834016.760697:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.760874:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.760931:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406172032 00000100:00100000:3.0:1787834016.760935:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406172032 00000100:00100000:3.0:1787834016.760965:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787834016.760971:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+6:17120:x1874679406172032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834016.761054:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+6:17120:x1874679406172032:12345-0@lo:501:mount.lustre.0 Request processed in 82us (356us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787834016.761061:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787834016.761124:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172032:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787834016.761151:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787834016.761168:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.761184:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834016.761193:0:17120:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df504d9f000 10000000:01000000:1.0:1787834016.761197:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787834016.761201:0:17120:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df504d9f000 10000000:01000000:1.0:1787834016.761204:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787834016.761206:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df504d9f000 from 1 10000000:01000000:1.0:1787834016.761214:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787834016.761232:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.761239:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.761247:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834016.761258:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834016.761284:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.761296:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.761453:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406172160 00000100:00100000:3.0:1787834016.761458:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406172160 00000100:00100000:3.0:1787834016.761476:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787834016.761481:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+6:17120:x1874679406172160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834016.761489:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834016.761500:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030e00/0x996d2fb20dc1e412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e40b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.761515:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030e00/0x996d2fb20dc1e412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e40b expref: 7 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.761532:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030e00/0x996d2fb20dc1e412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e40b expref: 7 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.761539:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030e00, rc 0) 00000100:00100000:3.0:1787834016.761577:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+7:17120:x1874679406172160:12345-0@lo:101:mount.lustre.0 Request processed in 95us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.761583:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787834016.761659:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834016.761670:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.761678:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834016.761690:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787834016.761703:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.761710:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834016.761716:0:17120:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787834016.761719:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787834016.761729:0:17120:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df504d9f000 10000000:01000000:1.0:1787834016.761732:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787834016.761734:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787834016.761736:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787834016.761773:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.761780:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.761788:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834016.761800:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834016.761825:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.761845:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.761896:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406172288 00000100:00100000:3.0:1787834016.761901:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406172288 00000100:00100000:3.0:1787834016.761919:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787834016.761924:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+7:17120:x1874679406172288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834016.761930:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834016.761938:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030600/0x996d2fb20dc1e420 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e419 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.761961:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030600/0x996d2fb20dc1e420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e419 expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.761969:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030600/0x996d2fb20dc1e420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e419 expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.761976:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030600, rc 0) 00000100:00100000:3.0:1787834016.762011:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+8:17120:x1874679406172288:12345-0@lo:101:mount.lustre.0 Request processed in 86us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.762016:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834016.762083:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834016.762093:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.762101:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834016.762144:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834016.762169:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.762195:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.762274:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406172416 00000100:00100000:3.0:1787834016.762279:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406172416 00000100:00100000:3.0:1787834016.762296:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787834016.762302:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+8:17120:x1874679406172416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834016.762493:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+9:17120:x1874679406172416:12345-0@lo:501:mount.lustre.0 Request processed in 190us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.762500:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787834016.763763:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834016.763811:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834016.763880:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.763908:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834016.763964:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406172544 00000100:00100000:2.0:1787834016.763970:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406172544 00000100:00100000:2.0:1787834016.764006:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834016.764015:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+9:17120:x1874679406172544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834016.764794:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+9:17120:x1874679406172544:12345-0@lo:503:mount.lustre.0 Request processed in 777us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834016.764803:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787834016.764922:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406172544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834016.765496:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17159:1874679406172672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787834016.765793:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834016.765827:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b3559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.765889:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406172672 00000100:00100000:3.0:1787834016.765896:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406172672 00000100:00100000:3.0:1787834016.765936:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787834016.765945:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502515050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+9:17159:x1874679406172672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834016.766663:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502515050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+9:17159:x1874679406172672:12345-0@lo:502:llog_process_th.0 Request processed in 718us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.766671:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787834016.766798:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17159:1874679406172672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787834016.766829:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787834016.766840:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834016.766842:0:17159:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787834016.766847:0:17159:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787834016.766849:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787834016.766864:0:17159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8df503f11a48) 00000020:00000080:0.0:1787834016.766879:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787834016.766888:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787834016.766958:0:17159:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787834016.766965:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1e42e 00000020:00000080:0.0:1787834016.767163:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787834016.767167:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787834016.767171:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834016.767172:0:17159:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787834016.767175:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787834016.767178:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834016.767180:0:17159:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787834016.767183:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787834016.767196:0:17159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8df503f13490) 00000020:00000080:0.0:1787834016.767206:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787834016.767211:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787834016.767214:0:17159:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787834016.767216:0:17159:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787834016.767222:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787834016.767275:0:17159:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df504d9f000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787834016.767294:0:17159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8df635428000) 00000020:00000080:0.0:1787834016.767303:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787834016.767360:0:17159:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787834016.767366:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1e443 00000020:00000080:0.0:1787834016.767601:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787834016.767607:0:17159:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787834016.767611:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x996d2fb20dc1e44a 00080000:01000000:0.0:1787834016.767616:0:17159:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787834016.767619:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1e451 00010000:00010000:3.0:1787834016.851645:0:17159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787834016.852780:0:17159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1787834016.853538:0:17159:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787834016.855736:0:17159:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8df5039b8000) 00000020:00000080:3.0:1787834016.855812:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787834016.855962:0:17159:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787834016.855970:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1e45f 00000020:00000080:3.0:1787834016.862140:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787834016.875588:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x996d2fb20dc1e466 00000020:00000080:2.0:1787834016.877220:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787834016.877235:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834016.877243:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834016.877245:0:17159:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787834016.877259:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787834016.877262:0:17159:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787834016.877263:0:17159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787834016.877264:0:17159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787834016.877266:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787834016.877268:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834016.877269:0:17159:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787834016.877272:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834016.877276:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834016.877278:0:17159:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787834016.877283:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787834016.877332:0:17159:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787834016.877353:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834016.877356:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834016.877357:0:17159:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787834016.877360:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834016.877362:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834016.877363:0:17159:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787834016.877366:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787834016.877371:0:17159:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:00000080:2.0:1787834016.877397:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787834016.877415:0:17159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8df60ef48000) 00000020:00000080:2.0:1787834016.877432:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787834016.877437:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787834016.877490:0:17159:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787834016.877496:0:17159:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787834016.877502:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1e474 00010000:00080000:2.0:1787834016.877542:0:17159:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df6187e2000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:2.0:1787834016.883536:0:17159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787834016.889923:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787834016.889941:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787834016.889982:0:17159:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787834016.890003:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1e47b 00000100:00080000:3.0:1787834016.890012:0:17159:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787834016.890017:0:17159:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df6187e2000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834016.890056:0:17159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502ec6580 x1874679406172800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834016.890093:0:17159:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787834016.890137:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406172800:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1787834016.890150:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834016.890153:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834016.890155:0:17159:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787834016.890157:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787834016.890160:0:17159:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787834016.890161:0:17159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787834016.890162:0:17159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787834016.890164:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787834016.890175:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834016.890177:0:17159:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787834016.890180:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787834016.890185:0:17159:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787834016.890188:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834016.890189:0:17159:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787834016.890191:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787834016.890195:0:17159:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:3.0:1787834016.890213:0:17159:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00100000:0.0:1787834016.890214:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787834016.890215:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787834016.890229:0:17159:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df5039bb490) 00000100:00100000:3.0:1787834016.890248:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406172800 00000100:00100000:3.0:1787834016.890255:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406172800 00000100:00100000:3.0:1787834016.890280:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834016.890286:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406172800:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787834016.890301:0:17146:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:2.0:1787834016.894888:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787834016.894912:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787834016.895024:0:17159:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787834016.895030:0:17159:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787834016.895042:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1e489 00010000:00080000:2.0:1787834016.895081:0:17159:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df50454a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:2.0:1787834016.895338:0:17159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787834016.902205:0:17159:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787834016.904023:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787834016.907230:0:17159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834016.907505:0:17159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:0.0:1787834016.927889:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406172800:12345-0@lo:38:llog_process_th.0 Request processed in 37595us (37667us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787834016.927908:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787834016.928204:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834016.928211:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787834016.928216:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406172800:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787834016.931145:0:17159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787834016.933133:0:17165:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787834016.933140:0:17165:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787834016.935570:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787834016.935589:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787834016.935642:0:17159:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787834016.936018:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1e490 00000100:00080000:1.0:1787834016.936030:0:17159:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834016.936037:0:17159:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df50454a800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834016.936080:0:17159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50250b0c0 x1874679406172928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787834016.936162:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406172928:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787834016.936218:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406172928 offset 0 length 520: 4 00000100:00080000:1.0:1787834016.937324:0:17159:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787834016.937412:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834016.937419:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.937421:0:17159:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787834016.937425:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787834016.937428:0:17159:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787834016.937429:0:17159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834016.937431:0:17159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834016.937432:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787834016.937435:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.937436:0:17159:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787834016.937439:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787834016.937443:0:17159:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787834016.937446:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.937461:0:17159:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787834016.937465:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787834016.937469:0:17159:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:1.0:1787834016.937491:0:17159:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787834016.937493:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834016.937507:0:17159:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df635860000) 00000020:00000080:1.0:1787834016.937536:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787834016.937542:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787834016.937614:0:17159:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787834016.937620:0:17159:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787834016.937627:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1e49e 00010000:00080000:1.0:1787834016.937655:0:17159:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df63fb42000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834016.941189:0:17159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787834016.941271:0:17159:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787834016.941289:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787834016.951213:0:17159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834016.953087:0:17159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787834016.953539:0:17159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787834016.956534:0:17167:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787834016.956543:0:17167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787834016.959995:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787834016.960015:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787834016.960064:0:17159:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787834016.960085:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1e4a5 00000100:00080000:2.0:1787834016.960099:0:17159:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787834016.960105:0:17159:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df63fb42000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834016.960143:0:17159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212fda40 x1874679406173056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787834016.960207:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406173056:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787834016.960281:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406173056 offset 0 length 520: 4 00000100:00080000:2.0:1787834016.960338:0:17159:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787834016.960408:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834016.960412:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834016.960413:0:17159:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787834016.960416:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834016.960419:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834016.960421:0:17159:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787834016.960423:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787834016.960425:0:17159:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787834016.960427:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834016.960429:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834016.960430:0:17159:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787834016.960432:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834016.960434:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834016.960441:0:17159:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787834016.960446:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787834016.960475:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17159:1874679406173184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787834016.960532:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834016.960553:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b355000 going to sleep for 11 seconds 00000100:00100000:2.0:1787834016.962001:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406173184 00000100:00100000:2.0:1787834016.962013:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406173184 00000100:00100000:2.0:1787834016.962068:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787834016.962078:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+9:17159:x1874679406173184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787834016.962243:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+9:17159:x1874679406173184:12345-0@lo:502:llog_process_th.0 Request processed in 166us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834016.962251:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787834016.963041:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17159:1874679406173184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787834016.963083:0:17159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834016.963092:0:17159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.963094:0:17159:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787834016.963101:0:17159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787834016.966050:0:17120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787834016.966093:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787834016.966119:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834016.966132:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834016.966141:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df504d9f000 from 1 10000000:01000000:2.0:1787834016.966144:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787834016.966186:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834016.966194:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834016.966204:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834016.966241:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834016.966306:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834016.966353:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b355000 going to sleep for 11 seconds 00000100:00100000:1.0:1787834016.966641:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406173312 00000100:00100000:1.0:1787834016.966649:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406173312 00000100:00100000:1.0:1787834016.966697:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787834016.966706:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+9:17120:x1874679406173312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834016.966719:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834016.966734:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e4ac expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.966808:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4ac expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.967013:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4ac expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.967022:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722000, rc 0) 00000100:00100000:1.0:1787834016.967084:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+10:17120:x1874679406173312:12345-0@lo:101:mount.lustre.0 Request processed in 379us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834016.967092:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787834016.967178:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834016.967194:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.967204:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834016.967737:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173440:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787834016.968167:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834016.968203:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469000 going to sleep for 11 seconds 00000100:00100000:1.0:1787834016.968296:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406173440 00000100:00100000:1.0:1787834016.968302:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406173440 00000100:00100000:1.0:1787834016.968333:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787834016.968340:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+10:17120:x1874679406173440:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787834016.968357:0:17133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787834016.968373:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787834016.968436:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+10:17120:x1874679406173440:12345-0@lo:256:mount.lustre.0 Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834016.968442:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787834016.968561:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173440:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787834016.969635:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787834016.970085:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.970098:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834016.970106:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df504d9f000 from 1 10000000:01000000:3.0:1787834016.970109:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787834016.970145:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.970153:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.970162:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834016.970180:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787834016.970234:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834016.970275:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469000 going to sleep for 11 seconds 00000100:00100000:1.0:1787834016.970331:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406173568 00000100:00100000:1.0:1787834016.970338:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406173568 00000100:00100000:1.0:1787834016.970390:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787834016.970397:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+10:17120:x1874679406173568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834016.970409:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834016.970420:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e4ba expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.970454:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4ba expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.970464:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4ba expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.970472:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722400, rc 0) 00000100:00100000:1.0:1787834016.970507:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17120:x1874679406173568:12345-0@lo:101:mount.lustre.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834016.970514:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787834016.970686:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834016.970709:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834016.970723:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834016.970825:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834016.970851:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834016.970872:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df610b37780 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.970987:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406173696 00000100:00100000:3.0:1787834016.970992:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406173696 00000100:00100000:3.0:1787834016.971026:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787834016.971033:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17120:x1874679406173696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834016.971166:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17120:x1874679406173696:12345-0@lo:501:mount.lustre.0 Request processed in 133us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.971173:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787834016.971463:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834016.971490:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834016.971542:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834016.971603:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df610b37780 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.972230:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406173824 00000100:00100000:3.0:1787834016.972238:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406173824 00000100:00100000:3.0:1787834016.972324:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834016.972332:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17120:x1874679406173824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834016.972463:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17120:x1874679406173824:12345-0@lo:503:mount.lustre.0 Request processed in 131us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.972470:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834016.972555:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406173824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834016.973227:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17169:1874679406173952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787834016.973274:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.974282:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e17c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787834016.974383:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406173952 00000100:00100000:2.0:1787834016.974390:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406173952 00000100:00100000:2.0:1787834016.974432:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787834016.974440:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17169:x1874679406173952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787834016.975263:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17169:x1874679406173952:12345-0@lo:502:llog_process_th.0 Request processed in 821us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834016.975272:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787834016.975382:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17169:1874679406173952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787834016.975412:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834016.975422:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.975424:0:17169:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787834016.975430:0:17169:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df504d9f000 00000020:00000080:1.0:1787834016.975433:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787834016.975441:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834016.975443:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.975444:0:17169:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787834016.975447:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834016.975449:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.975450:0:17169:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787834016.975453:0:17169:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df504d9f000 00000020:00000080:1.0:1787834016.975455:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787834016.975510:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834016.975529:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.975531:0:17169:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787834016.975534:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834016.975537:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.975538:0:17169:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787834016.975543:0:17169:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df504d9f000 00000020:00000080:1.0:1787834016.975544:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787834016.975565:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834016.975567:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.975568:0:17169:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787834016.975570:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834016.975572:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.975573:0:17169:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787834016.975576:0:17169:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df504d9f000 00000020:00000080:1.0:1787834016.975578:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787834016.975619:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17169:1874679406174080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787834016.975674:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.975713:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e17c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.976630:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406174080 00000100:00100000:3.0:1787834016.976640:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406174080 00000100:00100000:3.0:1787834016.977459:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787834016.977475:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17169:x1874679406174080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834016.977649:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17169:x1874679406174080:12345-0@lo:502:llog_process_th.0 Request processed in 178us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.977657:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787834016.977883:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17169:1874679406174080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787834016.977918:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834016.977926:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834016.977928:0:17169:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787834016.977933:0:17169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787834016.978952:0:17120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787834016.978982:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787834016.979010:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.979022:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834016.979094:0:17120:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787834016.979098:0:17120:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df504d9f000 10000000:01000000:1.0:1787834016.979101:0:17120:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df504d9f000 10000000:01000000:1.0:1787834016.979105:0:17120:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787834016.979111:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df504d9f000 from 1 10000000:01000000:1.0:1787834016.979114:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787834016.979149:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.979157:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.979167:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834016.979190:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406174208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834016.979245:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.979275:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e17c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.979351:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406174208 00000100:00100000:3.0:1787834016.979359:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406174208 00000100:00100000:3.0:1787834016.979400:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787834016.979408:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17120:x1874679406174208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834016.979422:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834016.979435:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030200/0x996d2fb20dc1e4cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e4c8 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.979460:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030200/0x996d2fb20dc1e4cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4c8 expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.979472:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030200/0x996d2fb20dc1e4cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4c8 expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834016.979480:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030200, rc 0) 00000100:00100000:3.0:1787834016.979533:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17120:x1874679406174208:12345-0@lo:101:mount.lustre.0 Request processed in 126us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.979546:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787834016.979716:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406174208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834016.979734:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834016.979742:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834016.980268:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406174336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834016.980305:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.980338:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e17c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.980406:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406174336 00000100:00100000:3.0:1787834016.980411:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406174336 00000100:00100000:3.0:1787834016.980437:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787834016.980443:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17120:x1874679406174336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834016.980572:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17120:x1874679406174336:12345-0@lo:501:mount.lustre.0 Request processed in 128us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.980579:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787834016.981189:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406174336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834016.981228:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406174464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834016.981277:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.981299:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e17c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834016.981351:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406174464 00000100:00100000:3.0:1787834016.981356:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406174464 00000100:00100000:3.0:1787834016.981442:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787834016.981449:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17120:x1874679406174464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834016.983689:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17120:x1874679406174464:12345-0@lo:503:mount.lustre.0 Request processed in 2232us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834016.983703:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787834016.993485:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406174464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834016.993953:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17173:1874679406174592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787834016.994021:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834016.994060:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406174592 00000100:00100000:1.0:1787834016.994065:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406174592 00000100:00100000:1.0:1787834016.994107:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787834016.994115:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17173:x1874679406174592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787834016.994223:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17173:x1874679406174592:12345-0@lo:502:llog_process_th.0 Request processed in 108us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834016.994231:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787834016.994277:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e17cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787834016.994289:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17173:1874679406174592:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787834016.994338:0:17173:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787834016.994352:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8df635864ed8) 00000020:00000080:1.0:1787834016.994381:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787834016.994451:0:17173:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df504d9f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787834016.994455:0:17173:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df504d9f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787834016.994457:0:17173:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df504d9f000 4 00010000:00080000:1.0:1787834016.994492:0:17173:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df502521800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834016.996137:0:17173:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1787834016.996331:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787834016.996376:0:17173:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787834016.996389:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x996d2fb20dc1e4dd 00000100:00080000:1.0:1787834016.996398:0:17173:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834016.996404:0:17173:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df502521800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834016.996445:0:17173:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50250ad00 x1874679406174720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787834016.996489:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406174720:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787834016.996564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787834016.996615:0:17173:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787834016.997086:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406174720 00000100:00100000:2.0:1787834016.997094:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406174720 00000100:00100000:2.0:1787834016.997123:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787834016.997131:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406174720:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787834016.997187:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406174720:12345-0@lo:38:llog_process_th.0 Request processed in 57us (623us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787834016.997194:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787834017.008658:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787834017.008671:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502521800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834017.008677:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787834017.008682:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406174720:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787834017.009490:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17173:1874679406174848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787834017.009590:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834017.009641:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e17c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787834017.014483:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406174848 00000100:00100000:3.0:1787834017.014499:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406174848 00000100:00100000:3.0:1787834017.014570:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787834017.014580:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17173:x1874679406174848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834017.014764:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17173:x1874679406174848:12345-0@lo:502:llog_process_th.0 Request processed in 171us (5159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834017.014773:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787834017.015563:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17173:1874679406174848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787834017.015630:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17173:1874679406174976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787834017.015685:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834017.015775:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e17c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787834017.024568:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406174976 00000100:00100000:0.0:1787834017.024584:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406174976 00000100:00100000:0.0:1787834017.025411:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787834017.025435:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17173:x1874679406174976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787834017.025614:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17173:x1874679406174976:12345-0@lo:502:llog_process_th.0 Request processed in 191us (9927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834017.025622:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787834017.026087:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17173:1874679406174976:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787834017.026127:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787834017.026192:0:17120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787834017.026213:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787834017.026238:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834017.026249:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787834017.026298:0:17120:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787834017.026300:0:17120:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787834017.026301:0:17120:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787834017.026303:0:17120:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787834017.026304:0:17120:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787834017.026305:0:17120:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787834017.026306:0:17120:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787834017.026308:0:17120:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787834017.026310:0:17120:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787834017.026311:0:17120:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787834017.026315:0:17120:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787834017.026317:0:17120:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787834017.026319:0:17120:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787834017.026320:0:17120:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787834017.026321:0:17120:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787834017.026322:0:17120:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787834017.026323:0:17120:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787834017.026324:0:17120:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787834017.026325:0:17120:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787834017.026326:0:17120:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787834017.026327:0:17120:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787834017.026346:0:17120:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787834017.027528:0:17120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406175104:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787834017.027594:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834017.035052:0:17120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e17c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787834017.035585:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406175104 00000100:00100000:3.0:1787834017.035594:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406175104 00000100:00100000:3.0:1787834017.035788:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787834017.035798:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17120:x1874679406175104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787834017.035856:0:17133:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787834017.035869:0:17133:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787834017.044940:0:17133:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787834017.045007:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787834017.045666:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17120:x1874679406175104:12345-0@lo:253:mount.lustre.0 Request processed in 9864us (18067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834017.045679:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787834017.045684:0:17120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17120:1874679406175104:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787834017.045700:0:17120:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787834017.045704:0:17120:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787834017.045706:0:17120:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787834017.045713:0:17120:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787834017.045715:0:17120:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787834017.045716:0:17120:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787834017.045717:0:17120:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787834017.045718:0:17120:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787834017.045720:0:17120:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787834017.045722:0:17120:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787834017.045724:0:17120:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787834017.045741:0:17120:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787834017.047949:0:17157:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787834017.047958:0:17157:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787834017.047988:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834017.048006:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4ac expref: 11 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834017.048030:0:17157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834017.048069:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e4ac expref: 11 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834017.048083:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ac expref: 11 pid: 17135 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834017.048096:0:17157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406175232:0@lo:104: 00000100:00100000:0.0:1787834017.048151:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834017.048193:0:17157:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df610b37540 going to sleep for 11 seconds 00000100:00100000:2.0:1787834017.053008:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406175232 00000100:00100000:2.0:1787834017.053021:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406175232 00000100:00100000:2.0:1787834017.053071:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787834017.053080:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:17157:x1874679406175232:12345-0@lo:104: 00010000:00010000:2.0:1787834017.053098:0:17124:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834017.053189:0:17124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787834017.053195:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:17157:x1874679406175232:12345-0@lo:104: Request processed in 117us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834017.053212:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787834017.053262:0:17157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406175232:0@lo:104: 00010000:00010000:2.0:1787834017.053283:0:17157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834017.053305:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834017.053311:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834017.053325:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccce00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834017.053330:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834017.053338:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834017.053346:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834017.053352:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787834017.053388:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834017.053395:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787834017.053416:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834017.053423:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504ccce00/0x996d2fb20dc1e4ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e4b3 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834017.053529:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834017.053531:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834017.053532:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834017.053638:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406175360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834017.053678:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834017.054216:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406175360 00000100:00100000:3.0:1787834017.054223:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406175360 00010000:00010000:3.0:1787834017.054251:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ac expref: 12 pid: 17135 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834017.054277:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834017.054284:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:3638:x1874679406175360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834017.054295:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834017.054300:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ac expref: 12 pid: 17135 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054311:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ac expref: 12 pid: 17135 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054327:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e4b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ac expref: 12 pid: 17135 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054342:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054350:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787834017.054375:0:17126:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006417157s 00010000:00010000:3.0:1787834017.054380:0:17126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054386:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054392:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054398:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054403:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834017.054407:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054415:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054433:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054442:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834017.054501:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:3638:x1874679406175360:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834017.054508:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787834017.054959:0:17157:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054979:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834017.054985:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504677800/0x996d2fb20dc1e4e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834017.055247:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406175360:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787834017.071971:0:17120:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787834017.076035:0:17120:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787834017.076403:0:17182:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787834017.076783:0:17120:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1787834017.077099:0:17182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1787834017.077903:0:17181:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787834017.077909:0:17181:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:2.0:1787834017.078640:0:17183:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8df6212ff840 x1874679406175488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834017.078653:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00000040:01000000:1.0:1787834017.079190:0:17120:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787834017.079226:0:17120:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787834017.079733:0:17120:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787834017.079742:0:17120:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787834017.080525:0:17120:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787834017.082454:0:17182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787834017.082534:0:17182:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1787834017.084230:0:17120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787834017.085066:0:17120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787834017.085110:0:17120:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787834017.086494:0:17120:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1787834017.088513:0:17120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787834017.090445:0:17120:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787834017.090478:0:17120:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9fc9c1c43988 00100000:10000000:2.0:1787834017.090486:0:17120:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787834017.091208:0:17120:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787834017.091227:0:17120:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787834017.091245:0:17120:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787834017.091274:0:17120:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787834017.098214:0:17120:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834017.098588:0:17120:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787834017.557980:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787834018.070803:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787834018.135128:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 10000000:01000000:3.0:1787834018.272676:0:17138:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787834018.272684:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df504d9f000 from 7 10000000:01000000:3.0:1787834018.272689:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787834018.272747:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834018.272782:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834018.272793:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834018.272819:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406175616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787834018.272881:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834018.272927:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787834018.273011:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406175616 00000100:00100000:0.0:1787834018.273028:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406175616 00000100:00100000:0.0:1787834018.273121:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787834018.273129:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+11:17138:x1874679406175616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834018.273141:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834018.273153:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e4eb expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834018.273174:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4eb expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834018.273184:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4eb expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834018.273212:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676600, rc 0) 00000100:00100000:0.0:1787834018.273272:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17138:x1874679406175616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834018.273279:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787834018.273476:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406175616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834018.273498:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834018.273507:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834018.273578:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406175744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787834018.273609:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834018.273634:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787834018.274882:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406175744 00000100:00100000:2.0:1787834018.274892:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406175744 00000100:00100000:2.0:1787834018.274942:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787834018.274950:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17138:x1874679406175744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787834018.274974:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787834018.276193:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787834018.276201:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787834018.276367:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17138:x1874679406175744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1396us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834018.276378:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787834018.278107:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406175744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787834018.278187:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787834018.278198:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834018.278210:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834018.586025:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834019.095311:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787834019.170074:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:3.0:1787834019.605944:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834020.182476:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:2.0:1787834020.629885:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834021.209713:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:3.0:1787834021.656863:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787834022.054689:0:17425:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1787834022.231644:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787834022.231651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787834022.231654:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834022.231663:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:0.0:1787834022.231669:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787834022.231677:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df6187e2000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834022.231700:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a99e00 x1874679406176000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787834022.231717:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834022.231721:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834022.231724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834022.231727:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834022.231729:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787834022.231732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787834022.231734:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df502521800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834022.231738:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df502521800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834022.231774:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a9bc00 x1874679406176128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787834022.231820:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406176000:0@lo:38:kworker.0 00000100:00100000:0.0:1787834022.231936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834022.231986:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406176128:0@lo:38:kworker.0 00000100:00100000:0.0:1787834022.232017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834022.232084:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406176000 00000100:00100000:0.0:1787834022.232091:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406176000 00000100:00100000:0.0:1787834022.232122:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787834022.232138:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874679406176000:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787834022.232155:0:17147:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787834022.233382:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406175872:0@lo:400:kworker.0 00000100:00100000:1.0:1787834022.233442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834022.233511:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406175872 00000100:00100000:1.0:1787834022.233517:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406175872 00000100:00100000:1.0:1787834022.233560:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787834022.233568:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:3639:x1874679406175872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834022.233621:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:3639:x1874679406175872:12345-0@lo:400:kworker.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834022.233628:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787834022.233671:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406175872:0@lo:400:kworker.0 00000100:00100000:3.0:1787834022.234420:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406176128 00000100:00100000:3.0:1787834022.234427:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406176128 00000100:00100000:3.0:1787834022.234452:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834022.234457:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406176128:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787834022.234488:0:17143:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1787834022.234534:0:17143:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x996d2fb20dc1e4f9 00000004:00100000:3.0:1787834022.234549:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787834022.234677:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8df6063ca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834022.234733:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874679406176128:12345-0@lo:38:kworker.0 Request processed in 274us (2714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834022.234741:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834022.238187:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00080000:1.0:1787834022.253323:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df635a9bc00 x1874679406176128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787834022.253355:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787834022.253364:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787834022.253369:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787834022.253387:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502521800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787834022.253395:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406176128:0@lo:38:kworker.0 00000100:00100000:0.0:1787834022.266965:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874679406176000:12345-0@lo:38:kworker.0 Request processed in 34819us (35022us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787834022.266980:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787834022.267290:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787834022.267297:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787834022.267301:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406176000:0@lo:38:kworker.0 00010000:00010000:2.0:1787834022.678964:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787834023.171448:0:17478:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834023.171668:0:17478:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787834023.254017:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:3.0:1787834023.707930:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787834023.928428:0:17528:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787834023.928617:0:17528:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787834024.279788:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:2.0:1787834024.735063:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834025.310930:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:3.0:1787834025.749946:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834026.325881:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834016/real 1787834016] req@ffff8df6212fda40 x1874679406173056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834026.325912:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df6212fda40 x1874679406173056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834026.325972:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834016/real 1787834016] req@ffff8df50250b0c0 x1874679406172928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834026.325986:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df50250b0c0 x1874679406172928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787834026.326005:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df63fb42000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834026.326030:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834026.326034:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406173056:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787834026.326040:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df50454a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834026.326045:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834026.326048:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406172928:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787834026.326166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787834026.326171:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787834026.326173:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834026.326178:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1787834026.326183:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787834026.326190:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df6187e2000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834026.326210:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502ec61c0 x1874679406176384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834026.326223:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834026.326225:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787834026.326227:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df50454a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834026.326230:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1787834026.326233:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787834026.326250:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df50454a800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834026.326262:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502ec4780 x1874679406176512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834026.326271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834026.326273:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787834026.326275:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df63fb42000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834026.326279:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1787834026.326281:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787834026.326283:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df63fb42000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834026.326293:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502ec43c0 x1874679406176640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787834026.326450:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406176768:0@lo:400:kworker.0 00000100:00100000:0.0:1787834026.326519:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834026.326569:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787834026.326574:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406176256:0@lo:400:kworker.0 00000100:00100000:0.0:1787834026.326618:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834026.326685:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406176384:0@lo:38:kworker.0 00000100:00100000:1.0:1787834026.326728:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834026.326777:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406176512:0@lo:8:kworker.0 00000400:00000100:1.0:1787834026.326800:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406176512 offset 0 length 520: 4 00000100:00100000:1.0:1787834026.326816:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406176640:0@lo:8:kworker.0 00000400:00000100:1.0:1787834026.326848:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406176640 offset 0 length 520: 4 00000100:00100000:1.0:1787834026.326880:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406176384 00000100:00100000:1.0:1787834026.326889:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406176384 00000100:00100000:1.0:1787834026.326920:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787834026.326927:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406176384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787834026.326944:0:17146:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787834026.329573:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00000100:00100000:3.0:1787834026.330999:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406176768 00000100:00100000:3.0:1787834026.331012:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406176768 00000100:00100000:3.0:1787834026.331065:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834026.331075:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406176768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834026.331155:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406176768:12345-0@lo:400:kworker.0 Request processed in 81us (4636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834026.331162:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787834026.337510:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406176256 00000100:00100000:2.0:1787834026.337524:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406176256 00010000:00080000:0.0:1787834026.337582:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df502ec6580 x1874679406176768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834026.337584:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787834026.337597:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:3641:x1874679406176256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834026.337603:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406176768:0@lo:400:kworker.0 00000100:00100000:2.0:1787834026.337673:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:3641:x1874679406176256:12345-0@lo:400:kworker.0 Request processed in 78us (11053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834026.337681:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406176256:0@lo:400:kworker.0 00000100:00100000:2.0:1787834026.337682:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787834026.360164:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406176384:12345-0@lo:38:kworker.0 Request processed in 33223us (33422us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787834026.360180:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787834026.364632:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787834026.364658:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787834026.364664:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406176384:0@lo:38:kworker.0 00010000:00010000:3.0:1787834026.776131:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834027.355288:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:2.0:1787834027.799884:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834028.374235:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:3.0:1787834028.824094:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834029.335526:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787834029.398709:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:2.0:1787834029.848203:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834030.423980:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00000020:01000004:0.0:1787834030.626152:0:17873:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787834030.626156:0:17873:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787834030.626158:0:17873:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787834030.626287:0:17873:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df611643000 00000020:01000004:0.0:1787834030.626303:0:17873:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787834030.626315:0:17873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787834030.626329:0:17873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8df63542ced8) 00000020:00000080:0.0:1787834030.626346:0:17873:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787834030.709451:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787834030.711082:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787834030.713887:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787834030.716563:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787834030.716953:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787834030.717561:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787834030.723404:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787834030.724166:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787834030.724588:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787834030.724891:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787834030.725509:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787834030.731371:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787834030.732013:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787834030.732620:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787834030.733599:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787834030.734612:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787834030.735468:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787834030.735813:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787834030.736081:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787834030.736538:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787834030.736771:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787834030.737040:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787834030.737400:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787834030.737613:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787834030.737827:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787834030.738077:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787834030.738438:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787834030.738831:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.739387:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.739684:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.739870:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787834030.740081:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.740362:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787834030.740536:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.743134:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787834030.743882:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787834030.744194:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787834030.744583:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787834030.744883:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.745506:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.746121:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787834030.746590:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.747105:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.747444:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.747637:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787834030.747989:0:17873:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00080000:01000000:1.0:1787834030.749003:0:17873:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787834030.749216:0:17873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787834030.749226:0:17873:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787834030.749237:0:17873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1e507 00000020:01000004:1.0:1787834030.749244:0:17873:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787834030.749274:0:17873:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787834030.749278:0:17873:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787834030.749285:0:17873:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787834030.749310:0:17873:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787834030.749315:0:17873:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787834030.754648:0:17873:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787834030.754687:0:17873:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.117@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787834030.754691:0:17873:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787834030.754693:0:17873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787834030.754694:0:17873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787834030.754695:0:17873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787834030.754697:0:17873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787834030.754698:0:17873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787834030.754699:0:17873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787834030.754701:0:17873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787834030.754702:0:17873:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787834030.754706:0:17873:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787834030.754708:0:17873:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787834030.754709:0:17873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787834030.754710:0:17873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787834030.754711:0:17873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787834030.754712:0:17873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787834030.754713:0:17873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787834030.754714:0:17873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787834030.754715:0:17873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787834030.754716:0:17873:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787834030.754741:0:17873:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787834030.754800:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406176896:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787834030.754876:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834030.755070:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406176896 00000100:00100000:0.0:1787834030.755078:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406176896 00000100:00100000:1.0:1787834030.755211:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df611df4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834030.755616:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787834030.755627:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17873:x1874679406176896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787834030.755658:0:17133:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787834030.755661:0:17133:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787834030.755674:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787834030.756079:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17873:x1874679406176896:12345-0@lo:253:mount.lustre.0 Request processed in 454us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834030.756087:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787834030.756164:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406176896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787834030.756174:0:17873:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787834030.756176:0:17873:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787834030.756178:0:17873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787834030.756179:0:17873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787834030.756180:0:17873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787834030.756181:0:17873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787834030.756183:0:17873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787834030.756184:0:17873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787834030.756185:0:17873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787834030.756187:0:17873:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787834030.756218:0:17873:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df611643000 from lustre-MDT0001 10000000:01000000:1.0:1787834030.756245:0:17873:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787834030.756248:0:17873:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787834030.756256:0:17873:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df503f10000 local copy 00010000:00010000:1.0:1787834030.756278:0:17873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834030.756364:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834030.756399:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834030.756880:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df611df4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787834030.756921:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406177024 00000100:00100000:2.0:1787834030.756926:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406177024 00000100:00100000:0.0:1787834030.757140:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787834030.757149:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17873:x1874679406177024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834030.757443:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17873:x1874679406177024:12345-0@lo:501:mount.lustre.0 Request processed in 294us (1042us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787834030.757452:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787834030.757651:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177024:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787834030.757670:0:17873:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787834030.757691:0:17873:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787834030.757699:0:17873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834030.757709:0:17873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834030.757736:0:17873:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df611643000 10000000:01000000:1.0:1787834030.757819:0:17873:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787834030.757826:0:17873:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df503f10000 10000000:01000000:1.0:1787834030.757830:0:17873:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787834030.757834:0:17873:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df503f10000 from 1 10000000:01000000:1.0:1787834030.757837:0:17873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787834030.757864:0:17873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834030.757873:0:17873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834030.757883:0:17873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834030.757899:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834030.757930:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834030.758068:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df611df4300 going to sleep for 11 seconds 00000100:00100000:0.0:1787834030.758115:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406177152 00000100:00100000:0.0:1787834030.758120:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406177152 00000100:00100000:0.0:1787834030.758154:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787834030.758162:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+12:17873:x1874679406177152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834030.758171:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834030.758183:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676e00/0x996d2fb20dc1e515 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e50e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834030.758214:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676e00/0x996d2fb20dc1e515 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e50e expref: 13 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834030.758226:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676e00/0x996d2fb20dc1e515 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e50e expref: 13 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834030.758236:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676e00, rc 0) 00000100:00100000:0.0:1787834030.758528:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+13:17873:x1874679406177152:12345-0@lo:101:mount.lustre.0 Request processed in 365us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834030.758535:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787834030.758594:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834030.758607:0:17873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e515 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834030.758615:0:17873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e515 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834030.758630:0:17873:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787834030.758677:0:17873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e515 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834030.758684:0:17873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e515 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834030.758706:0:17873:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df611643000 10000000:01000000:1.0:1787834030.758710:0:17873:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787834030.758713:0:17873:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df611643000 from 1 10000000:01000000:1.0:1787834030.758715:0:17873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787834030.758732:0:17873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834030.758739:0:17873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834030.758747:0:17873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834030.758779:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834030.758820:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834030.758884:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df611df4300 going to sleep for 11 seconds 00000100:00100000:0.0:1787834030.759640:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406177280 00000100:00100000:0.0:1787834030.759656:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406177280 00000100:00100000:0.0:1787834030.759702:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787834030.759710:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+13:17873:x1874679406177280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834030.759721:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834030.759731:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504677c00/0x996d2fb20dc1e523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e51c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834030.759778:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677c00/0x996d2fb20dc1e523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e51c expref: 14 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834030.759789:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504677c00/0x996d2fb20dc1e523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e51c expref: 14 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834030.759797:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677c00, rc 0) 00000100:00100000:0.0:1787834030.759897:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+14:17873:x1874679406177280:12345-0@lo:101:mount.lustre.0 Request processed in 187us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834030.759904:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787834030.760692:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834030.761071:0:17873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.761099:0:17873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834030.761116:0:17873:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787834030.761165:0:17873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.761174:0:17873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834030.761180:0:17873:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787834030.761186:0:17873:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787834030.761191:0:17873:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df611643000 10000000:01000000:3.0:1787834030.761194:0:17873:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787834030.761207:0:17873:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787834030.761210:0:17873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787834030.761237:0:17873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.761245:0:17873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.761253:0:17873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834030.761456:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787834030.761506:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834030.761546:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340780 going to sleep for 11 seconds 00000100:00100000:0.0:1787834030.761621:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406177408 00000100:00100000:0.0:1787834030.761627:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406177408 00000100:00100000:0.0:1787834030.761675:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787834030.761683:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+14:17873:x1874679406177408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834030.761696:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834030.761707:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676a00/0x996d2fb20dc1e531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e52a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834030.761727:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676a00/0x996d2fb20dc1e531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e52a expref: 15 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834030.761736:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676a00/0x996d2fb20dc1e531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e52a expref: 15 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834030.761768:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676a00, rc 0) 00000100:00100000:0.0:1787834030.761813:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406177408:12345-0@lo:101:mount.lustre.0 Request processed in 129us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834030.761820:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787834030.761906:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834030.761917:0:17873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.761925:0:17873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787834030.763834:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1787834030.765406:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787834030.770617:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787834030.770676:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787834030.770692:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787834030.770706:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787834030.770722:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1787834030.770735:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1787834030.770775:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1787834030.770794:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787834030.770809:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787834030.770821:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1787834030.770838:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1787834030.770852:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1787834030.770864:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1787834030.770878:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787834030.770891:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787834030.770905:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1787834030.770918:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787834030.770931:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787834030.770945:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1787834030.771031:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787834030.771053:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787834030.771067:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787834030.771079:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787834030.771116:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1787834030.771123:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1787834030.771229:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834030.771476:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834030.771526:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787834030.771612:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406177536 00000100:00100000:2.0:1787834030.771619:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406177536 00000100:00100000:2.0:1787834030.771716:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787834030.771726:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406177536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834030.771902:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406177536:12345-0@lo:501:mount.lustre.0 Request processed in 177us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834030.771911:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787834030.772008:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834030.772039:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834030.772079:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834030.777020:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787834030.777172:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406177664 00000100:00100000:0.0:1787834030.777181:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406177664 00000100:00100000:0.0:1787834030.777242:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787834030.777252:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406177664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834030.778656:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177664:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787834030.779578:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787834030.779669:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834030.779736:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834030.779905:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340780 going to sleep for 11 seconds 00000100:00100000:0.0:1787834030.779985:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406177664:12345-0@lo:503:mount.lustre.0 Request processed in 2732us (7903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834030.779996:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787834030.780036:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406177792 00000100:00100000:0.0:1787834030.780043:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406177792 00000100:00100000:2.0:1787834030.780156:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787834030.780168:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406177792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834030.781640:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406177792:12345-0@lo:502:mount.lustre.0 Request processed in 1469us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834030.781651:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787834030.781732:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834030.782445:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787834030.782479:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1787834030.782496:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1787834030.782510:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1787834030.782523:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1787834030.782538:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1787834030.782551:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1787834030.782567:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1787834030.782581:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1787834030.782593:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1787834030.782608:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1787834030.782633:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1787834030.782647:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1787834030.782659:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1787834030.782672:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1787834030.782684:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1787834030.782696:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1787834030.782709:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1787834030.782721:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1787834030.782733:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1787834030.782746:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1787834030.783067:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1787834030.783085:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1787834030.783102:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1787834030.783118:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1787834030.783130:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1787834030.783144:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1787834030.783158:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1787834030.783170:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1787834030.783185:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1787834030.783381:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1787834030.783405:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1787834030.783420:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1787834030.783449:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1787834030.783464:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1787834030.783477:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1787834030.783492:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1787834030.783505:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1787834030.783522:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1787834030.783537:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1787834030.783551:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1787834030.783565:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1787834030.783579:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1787834030.783595:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1787834030.783646:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834030.783717:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834030.783848:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df611df4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787834030.784027:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406177920 00000100:00100000:2.0:1787834030.784033:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406177920 00000100:00100000:2.0:1787834030.784122:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787834030.784132:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406177920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834030.784261:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406177920:12345-0@lo:502:mount.lustre.0 Request processed in 130us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834030.784281:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787834030.784363:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406177920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834030.784413:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1787834030.784431:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787834030.785333:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834030.785344:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.785346:0:17877:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787834030.785352:0:17877:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787834030.785355:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834030.785368:0:17877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8df635863490) 00000020:00000080:1.0:1787834030.785389:0:17877:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787834030.785394:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787834030.785477:0:17877:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787834030.785484:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1e53f 00000020:00000080:1.0:1787834030.785677:0:17877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787834030.785681:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834030.785685:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.785686:0:17877:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787834030.785689:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834030.785693:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.785694:0:17877:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787834030.785698:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834030.785705:0:17877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8df5027c4ed8) 00000020:00000080:1.0:1787834030.785715:0:17877:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787834030.785719:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787834030.785721:0:17877:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787834030.785724:0:17877:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787834030.785729:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787834030.785800:0:17877:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df611643000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787834030.785821:0:17877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8df5027c3490) 00000020:00000080:1.0:1787834030.785830:0:17877:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787834030.785900:0:17877:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787834030.785905:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1e554 00000020:00000080:1.0:1787834030.786227:0:17877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787834030.786236:0:17877:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787834030.786241:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x996d2fb20dc1e55b 00080000:01000000:1.0:1787834030.786247:0:17877:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787834030.786250:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1e562 00010000:00010000:2.0:1787834030.871404:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834030.893586:0:17877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787834030.894379:0:17877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787834030.894671:0:17877:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787834030.896724:0:17877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787834030.896737:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834030.896744:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834030.896746:0:17877:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787834030.896783:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834030.896790:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834030.896791:0:17877:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787834030.896795:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787834030.896800:0:17877:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:00000080:2.0:1787834030.896828:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787834030.896844:0:17877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8df60ef49a48) 00000020:00000080:2.0:1787834030.896865:0:17877:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787834030.896871:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787834030.896937:0:17877:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787834030.896943:0:17877:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787834030.896949:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1e570 00010000:00080000:2.0:1787834030.897418:0:17877:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df602e42000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1787834030.911703:0:17877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787834030.912868:0:17877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787834030.912882:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787834030.912918:0:17877:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787834030.912939:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1e577 00000100:00080000:1.0:1787834030.912950:0:17877:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834030.912955:0:17877:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8df602e42000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834030.912989:0:17877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502509e00 x1874679406178048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834030.913018:0:17877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787834030.913076:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834030.913080:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.913082:0:17877:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787834030.913085:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787834030.913088:0:17877:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787834030.913089:0:17877:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834030.913091:0:17877:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834030.913092:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787834030.913094:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.913095:0:17877:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787834030.913098:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834030.913102:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.913103:0:17877:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787834030.913107:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787834030.913142:0:17877:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787834030.913156:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834030.913159:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.913160:0:17877:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787834030.913163:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787834030.913165:0:17877:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1787834030.913166:0:17877:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834030.913167:0:17877:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834030.913169:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787834030.913171:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.913172:0:17877:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787834030.913175:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787834030.913177:0:17877:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787834030.913181:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.913182:0:17877:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787834030.913185:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787834030.913189:0:17877:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000100:00080000:3.0:1787834030.913307:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787834030.913312:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787834030.913315:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834030.913319:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:3.0:1787834030.913323:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787834030.913328:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df6187e2000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834030.913344:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502ec5a40 x1874679406178176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834030.913362:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834030.913365:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834030.913368:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834030.913370:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787834030.913412:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406178304:0@lo:400:kworker.0 00000100:00100000:3.0:1787834030.913501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834030.913577:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406178304 00000100:00100000:3.0:1787834030.913584:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406178304 00000100:00100000:3.0:1787834030.913625:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834030.913632:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406178304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834030.913684:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406178304:12345-0@lo:400:kworker.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834030.913691:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787834030.913732:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df502ec5e00 x1874679406178304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834030.913745:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406178304:0@lo:400:kworker.0 00000020:01000000:1.0:1787834030.914056:0:17877:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787834030.914061:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834030.914074:0:17877:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8df5027c1a48) 00000020:00000080:1.0:1787834030.914088:0:17877:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787834030.914094:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787834030.914168:0:17877:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787834030.914175:0:17877:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787834030.914181:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1e585 00010000:00080000:1.0:1787834030.914377:0:17877:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df602ac8800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834030.914593:0:17877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1787834030.915062:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406178048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787834030.915125:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834030.915173:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406178176:0@lo:38:kworker.0 00000100:00100000:2.0:1787834030.915201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834030.915299:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406178048 00000100:00100000:2.0:1787834030.915306:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406178048 00000100:00100000:2.0:1787834030.915325:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406178176 00000100:00100000:2.0:1787834030.915327:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406178176 00000100:00100000:2.0:1787834030.915338:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787834030.915344:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406178048:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787834030.915369:0:17146:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1787834030.915401:0:17146:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1e58c 00000004:00100000:2.0:1787834030.915415:0:17146:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787834030.915433:0:17146:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:1.0:1787834030.916143:0:17877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787834030.916469:0:17877:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787834030.918690:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834030.919044:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787834030.919164:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1787834030.919686:0:17882:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787834030.919691:0:17882:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787834030.920451:0:17877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787834030.920463:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787834030.920501:0:17877:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787834030.920522:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1e593 00000100:00080000:1.0:1787834030.920533:0:17877:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834030.920539:0:17877:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df602ac8800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834030.920574:0:17877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50250a1c0 x1874679406178432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834030.920605:0:17877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787834030.920652:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834030.920656:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.920658:0:17877:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787834030.920661:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787834030.920664:0:17877:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787834030.920665:0:17877:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834030.920667:0:17877:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834030.920668:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787834030.920670:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.920671:0:17877:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787834030.920674:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787834030.920678:0:17877:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787834030.920682:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.920683:0:17877:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787834030.920686:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787834030.920689:0:17877:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:1.0:1787834030.920711:0:17877:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787834030.920714:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834030.920725:0:17877:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8df5027c0000) 00000020:00000080:1.0:1787834030.920736:0:17877:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787834030.920747:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787834030.920850:0:17877:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787834030.920856:0:17877:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787834030.920862:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1e5a1 00010000:00080000:1.0:1787834030.920892:0:17877:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df635806800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834030.921087:0:17877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787834030.921146:0:17877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787834030.921160:0:17877:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1787834030.921325:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406178432:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787834030.921374:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406178432 offset 0 length 520: 4 00000100:00080000:2.0:1787834030.925046:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834030.925054:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834030.925058:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834030.925060:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787834030.925600:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834030.926072:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787834030.926191:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787834030.927604:0:17884:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787834030.927610:0:17884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787834030.928494:0:17877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787834030.928506:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787834030.928545:0:17877:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787834030.928567:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1e5a8 00000100:00080000:1.0:1787834030.928579:0:17877:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834030.928585:0:17877:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df635806800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834030.928618:0:17877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50250a940 x1874679406178560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834030.928645:0:17877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787834030.928745:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834030.928772:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.928774:0:17877:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787834030.928778:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834030.928782:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.928783:0:17877:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787834030.928786:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787834030.928788:0:17877:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787834030.928790:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834030.928799:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.928801:0:17877:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787834030.928804:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834030.928806:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.928808:0:17877:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787834030.928811:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787834030.928836:0:17877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834030.928840:0:17877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834030.928841:0:17877:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787834030.928844:0:17877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00100000:0.0:1787834030.928933:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406178560:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787834030.928986:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406178560 offset 0 length 520: 4 00000100:00080000:0.0:1787834030.929278:0:17146:0:(import.c:65:import_set_state_nolock()) ffff8df6065e5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787834030.929345:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874679406178048:12345-0@lo:38:llog_process_th.0 Request processed in 14000us (14219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834030.929355:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787834030.929377:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834030.929383:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406178176:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787834030.929433:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406178176:12345-0@lo:38:kworker.0 Request processed in 38us (14220us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787834030.929446:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787834030.929640:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787834030.929650:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787834030.929657:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787834030.929662:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787834030.929664:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df602e42000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787834030.929684:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406178048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787834030.929697:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787834030.929707:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787834030.929710:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787834030.929714:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406178176:0@lo:38:kworker.0 00000100:00100000:3.0:1787834030.929939:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406178688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834030.929974:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834030.930055:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406178688 00000100:00100000:0.0:1787834030.930061:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406178688 00000100:00100000:0.0:1787834030.930104:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787834030.930111:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1874679406178688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787834030.930140:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787834030.930179:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1874679406178688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834030.930185:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787834030.930276:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406178688:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787834030.930507:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834030.930513:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834030.930515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834030.930518:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1787834030.930728:0:17873:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787834030.930947:0:17873:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787834030.930970:0:17873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.930982:0:17873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834030.930990:0:17873:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df611643000 from 1 10000000:01000000:3.0:1787834030.930993:0:17873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787834030.931020:0:17873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.931029:0:17873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.931038:0:17873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834030.931055:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406178816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787834030.931092:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834030.931127:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63b340780 going to sleep for 11 seconds 00000100:00100000:2.0:1787834030.931406:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406178816 00000100:00100000:2.0:1787834030.931412:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406178816 00000100:00100000:2.0:1787834030.931465:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787834030.931480:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+15:17873:x1874679406178816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834030.931492:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834030.931504:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e5af expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834030.931539:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5af expref: 16 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834030.931549:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5af expref: 16 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834030.931557:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccd200, rc 0) 00000100:00100000:2.0:1787834030.931603:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+16:17873:x1874679406178816:12345-0@lo:101:mount.lustre.0 Request processed in 124us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834030.931610:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787834030.931717:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406178816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834030.931731:0:17873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834030.931739:0:17873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834030.932864:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406178944:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787834030.932919:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834030.932952:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787834030.934786:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406178944 00000100:00100000:3.0:1787834030.934800:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406178944 00000100:00100000:3.0:1787834030.934865:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787834030.934875:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+16:17873:x1874679406178944:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787834030.934900:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787834030.934920:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787834030.934923:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787834030.935041:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+16:17873:x1874679406178944:12345-0@lo:256:mount.lustre.0 Request processed in 167us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834030.935049:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787834030.935480:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406178944:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787834030.936137:0:17873:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787834030.936153:0:17873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834030.936166:0:17873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834030.936174:0:17873:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df611643000 from 1 10000000:01000000:2.0:1787834030.936177:0:17873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787834030.937404:0:17873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834030.937418:0:17873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834030.937471:0:17873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834030.937495:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834030.937561:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834030.937647:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e138d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834030.937887:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406179072 00000100:00100000:3.0:1787834030.937895:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406179072 00000100:00100000:3.0:1787834030.937978:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787834030.937988:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+16:17873:x1874679406179072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834030.938000:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834030.938011:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e5bd expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.938034:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5bd expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.938044:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5bd expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834030.938052:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030800, rc 0) 00000100:00100000:3.0:1787834030.938138:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179072:12345-0@lo:101:mount.lustre.0 Request processed in 152us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834030.938145:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787834030.938228:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834030.938245:0:17873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834030.938253:0:17873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787834030.939846:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787834030.939898:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834030.942539:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834030.942647:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604e30300 going to sleep for 11 seconds 00000100:00100000:3.0:1787834030.943415:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406179200 00000100:00100000:3.0:1787834030.943449:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406179200 00000100:00100000:3.0:1787834030.943505:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787834030.943513:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834030.943727:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179200:12345-0@lo:501:mount.lustre.0 Request processed in 214us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834030.943736:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787834030.954109:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834030.954176:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834030.954516:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834030.954564:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a6b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787834030.954690:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406179328 00000100:00100000:3.0:1787834030.954697:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406179328 00000100:00100000:3.0:1787834030.954779:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787834030.954788:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179328:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834030.954912:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179328:12345-0@lo:503:mount.lustre.0 Request processed in 124us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834030.954919:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787834030.955405:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179328:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787834030.959708:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787834030.959839:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834030.959917:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834030.959965:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a6b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787834030.960946:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406179456 00000100:00100000:2.0:1787834030.960956:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406179456 00000100:00100000:2.0:1787834030.961017:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787834030.961027:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834030.961180:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179456:12345-0@lo:502:mount.lustre.0 Request processed in 153us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834030.961187:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787834030.961394:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834030.961641:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787834030.961671:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787834030.961683:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787834030.961696:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787834030.961711:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787834030.961724:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787834030.961735:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787834030.961773:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787834030.961792:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787834030.961805:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787834030.961817:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787834030.961848:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834030.961894:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834030.961934:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604e30840 going to sleep for 11 seconds 00000100:00100000:0.0:1787834030.963707:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406179584 00000100:00100000:0.0:1787834030.963722:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406179584 00000100:00100000:0.0:1787834030.963805:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787834030.963815:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834030.963996:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179584:12345-0@lo:502:mount.lustre.0 Request processed in 182us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834030.964004:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787834030.964127:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834030.964612:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787834030.964630:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787834030.978498:0:17886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834030.978512:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834030.978514:0:17886:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787834030.978522:0:17886:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df611643000 00000020:00000080:3.0:1787834030.978524:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834030.978531:0:17886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834030.978534:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834030.978535:0:17886:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787834030.978537:0:17886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834030.978539:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834030.978541:0:17886:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787834030.978544:0:17886:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df611643000 00000020:00000080:3.0:1787834030.978546:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834030.978614:0:17886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834030.978618:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834030.978619:0:17886:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787834030.978621:0:17886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834030.978637:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834030.978638:0:17886:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834030.978643:0:17886:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df611643000 00000020:00000080:3.0:1787834030.978644:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834030.978662:0:17886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834030.978665:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834030.978666:0:17886:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834030.978668:0:17886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834030.978671:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834030.978672:0:17886:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787834030.978675:0:17886:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df611643000 00000020:00000080:3.0:1787834030.978677:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834030.978696:0:17886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834030.978699:0:17886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834030.978701:0:17886:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787834030.978704:0:17886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1787834030.990864:0:17873:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787834030.990913:0:17873:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787834030.990940:0:17873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834030.990953:0:17873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834030.991023:0:17873:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787834030.991027:0:17873:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df611643000 10000000:01000000:2.0:1787834030.991030:0:17873:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df611643000 10000000:01000000:2.0:1787834030.991035:0:17873:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787834030.991041:0:17873:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df611643000 from 1 10000000:01000000:2.0:1787834030.991044:0:17873:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787834030.991092:0:17873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834030.991102:0:17873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834030.991112:0:17873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834030.991137:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834030.991205:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834030.991307:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e138840 going to sleep for 11 seconds 00000100:00100000:0.0:1787834031.003382:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406179712 00000100:00100000:0.0:1787834031.003398:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406179712 00000100:00100000:0.0:1787834031.003482:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787834031.003491:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17873:x1874679406179712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834031.003519:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834031.003538:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676400/0x996d2fb20dc1e5d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e5cb expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834031.003568:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676400/0x996d2fb20dc1e5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5cb expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834031.003579:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676400/0x996d2fb20dc1e5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5cb expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834031.003588:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676400, rc 0) 00000100:00100000:0.0:1787834031.003676:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406179712:12345-0@lo:101:mount.lustre.0 Request processed in 187us (12471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834031.003682:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787834031.005113:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834031.005138:0:17873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834031.005151:0:17873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787834031.014635:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787834031.015086:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834031.016025:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787834031.016058:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1787834031.016072:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1787834031.016085:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1787834031.016100:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1787834031.016113:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1787834031.016125:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1787834031.016137:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1787834031.016147:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1787834031.016161:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1787834031.016174:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1787834031.016188:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1787834031.016201:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1787834031.016232:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1787834031.016247:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1787834031.016259:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1787834031.017135:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1787834031.017161:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1787834031.017186:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1787834031.017200:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1787834031.017213:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1787834031.017226:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1787834031.017239:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1787834031.017253:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1787834031.017265:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1787834031.017354:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1787834031.017370:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1787834031.017386:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1787834031.017411:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1787834031.017418:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787834031.017533:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834031.017604:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834031.017651:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e1380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834031.017726:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406179840 00000100:00100000:1.0:1787834031.017733:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406179840 00000100:00100000:1.0:1787834031.017813:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787834031.017822:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406179840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834031.017943:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406179840:12345-0@lo:501:mount.lustre.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834031.017951:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787834031.018055:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834031.018089:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834031.018127:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834031.018155:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e1380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834031.018183:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406179968 00000100:00100000:2.0:1787834031.018187:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406179968 00000100:00100000:2.0:1787834031.018215:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787834031.018221:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406179968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834031.018727:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406179968:12345-0@lo:503:mount.lustre.0 Request processed in 505us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834031.018735:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787834031.025278:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406179968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787834031.025823:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787834031.025922:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406180096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834031.025997:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834031.026036:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787834031.029610:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406180096 00000100:00100000:1.0:1787834031.029623:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406180096 00000100:00100000:1.0:1787834031.029676:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787834031.029685:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406180096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834031.029858:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406180096:12345-0@lo:502:mount.lustre.0 Request processed in 173us (3861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834031.029867:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787834031.030355:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406180096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787834031.030600:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787834031.030639:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1787834031.030652:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1787834031.030668:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1787834031.030679:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1787834031.030689:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1787834031.030699:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1787834031.030709:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1787834031.030720:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1787834031.030730:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1787834031.030776:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1787834031.030792:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1787834031.030803:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1787834031.030813:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1787834031.030824:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1787834031.030833:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1787834031.030843:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1787834031.030853:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1787834031.030863:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1787834031.030873:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1787834031.030883:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1787834031.030893:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1787834031.030903:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1787834031.030913:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1787834031.030923:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1787834031.030933:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1787834031.030953:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1787834031.030965:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1787834031.030981:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1787834031.030991:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1787834031.031001:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1787834031.031012:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1787834031.031022:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1787834031.031032:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1787834031.031043:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1787834031.031053:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1787834031.031063:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1787834031.031073:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1787834031.031083:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1787834031.031093:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1787834031.031103:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1787834031.031114:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1787834031.031132:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1787834031.031143:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1787834031.031154:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1787834031.031164:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1787834031.031174:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1787834031.031184:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1787834031.031223:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406180224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834031.032059:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834031.033109:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834031.033610:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406180224 00000100:00100000:1.0:1787834031.033620:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406180224 00000100:00100000:1.0:1787834031.033674:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787834031.033685:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50458b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406180224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834031.033855:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50458b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406180224:12345-0@lo:502:mount.lustre.0 Request processed in 171us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834031.033863:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787834031.034393:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406180224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787834031.034639:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1787834031.034667:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1787834031.034701:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406180352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834031.035360:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834031.035409:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834031.035916:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406180352 00000100:00100000:1.0:1787834031.035924:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406180352 00000100:00100000:1.0:1787834031.035978:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787834031.035987:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406180352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834031.036352:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406180352:12345-0@lo:502:mount.lustre.0 Request processed in 365us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834031.036360:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787834031.036415:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406180352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834031.036511:0:17873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1787834031.036524:0:17873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787834031.042846:0:17893:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787834031.042864:0:17893:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8df60ef4ced8) 00000020:00000080:2.0:1787834031.042894:0:17893:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787834031.042989:0:17893:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df611643000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787834031.042993:0:17893:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df611643000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787834031.042996:0:17893:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df611643000 3 00010000:00080000:2.0:1787834031.043027:0:17893:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df60665c800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:2.0:1787834031.045188:0:17893:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787834031.045396:0:17893:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787834031.045449:0:17893:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787834031.045462:0:17893:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x996d2fb20dc1e5e0 00000100:00080000:2.0:1787834031.045474:0:17893:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787834031.045480:0:17893:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8df60665c800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834031.045514:0:17893:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212fde00 x1874679406180480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787834031.045542:0:17893:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787834031.045576:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834031.045581:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834031.045584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834031.045587:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787834031.047498:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406180480:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787834031.047575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787834031.049635:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:3.0:1787834031.050389:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406180480 00000100:00100000:3.0:1787834031.050398:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406180480 00000100:00100000:3.0:1787834031.050450:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787834031.050459:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406180480:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787834031.050490:0:17143:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1787834031.050526:0:17143:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x996d2fb20dc1e5e7 00000004:00100000:3.0:1787834031.050542:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787834031.050575:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8df606528800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834031.050661:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874679406180480:12345-0@lo:38:llog_process_th.0 Request processed in 202us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834031.050669:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787834031.050721:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df6212fde00 x1874679406180480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834031.050733:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787834031.050747:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787834031.050771:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787834031.050775:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787834031.050778:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df60665c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787834031.050784:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406180480:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1787834031.052094:0:17873:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787834031.052143:0:17873:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787834031.052202:0:17873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834031.052214:0:17873:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787834031.052264:0:17873:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787834031.052276:0:17873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787834031.052278:0:17873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834031.052279:0:17873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834031.052280:0:17873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834031.052282:0:17873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834031.052283:0:17873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787834031.052285:0:17873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834031.052287:0:17873:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787834031.052291:0:17873:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787834031.052293:0:17873:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787834031.052294:0:17873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787834031.052296:0:17873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834031.052297:0:17873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834031.052298:0:17873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834031.052299:0:17873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834031.052300:0:17873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787834031.052301:0:17873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834031.052302:0:17873:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787834031.052326:0:17873:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787834031.052345:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406180608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787834031.052403:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834031.052451:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787834031.052473:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406180608 00000100:00100000:0.0:1787834031.052478:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406180608 00000100:00100000:0.0:1787834031.052682:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787834031.052691:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406180608:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787834031.052734:0:17136:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787834031.052768:0:17136:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787834031.061039:0:17121:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787834031.061111:0:17136:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787834031.061126:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787834031.061416:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17873:x1874679406180608:12345-0@lo:253:mount.lustre.0 Request processed in 8720us (9006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834031.061440:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787834031.061509:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17873:1874679406180608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787834031.061522:0:17873:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787834031.061526:0:17873:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787834031.061528:0:17873:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787834031.061529:0:17873:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834031.061530:0:17873:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834031.061531:0:17873:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834031.061533:0:17873:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834031.061534:0:17873:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787834031.061537:0:17873:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834031.061538:0:17873:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787834031.061554:0:17873:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787834031.062369:0:17157:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787834031.062376:0:17157:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787834031.062397:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062414:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4eb expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062433:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5af expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062441:0:17157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062480:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e5af expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062496:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5af expref: 17 pid: 17133 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834031.062509:0:17157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406180736:0@lo:104: 00000100:00100000:3.0:1787834031.062558:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787834031.062608:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e4eb expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062629:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4eb expref: 17 pid: 17136 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834031.062638:0:17157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406180864:0@lo:104: 00000100:00100000:3.0:1787834031.062661:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834031.062677:0:17157:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6205413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834031.062713:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406180736 00000100:00100000:3.0:1787834031.062719:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406180736 00000100:00100000:3.0:1787834031.062767:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406180864 00000100:00100000:3.0:1787834031.062770:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406180864 00000100:00100000:3.0:1787834031.062786:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834031.062794:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:17157:x1874679406180736:12345-0@lo:104: 00010000:00010000:3.0:1787834031.062806:0:17125:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062854:0:17125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787834031.062860:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:17157:x1874679406180736:12345-0@lo:104: Request processed in 67us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834031.062867:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834031.062883:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787834031.062889:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:17157:x1874679406180864:12345-0@lo:104: 00010000:00010000:3.0:1787834031.062896:0:17125:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062927:0:17125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787834031.062932:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:17157:x1874679406180864:12345-0@lo:104: Request processed in 44us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834031.062949:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787834031.062969:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834031.062975:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062983:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787834031.062986:0:17129:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.062995:0:17129:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787834031.063003:0:17129:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834031.063008:0:17129:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787834031.063035:0:17129:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063042:0:17129:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787834031.063062:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063069:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600030000/0x996d2fb20dc1e5af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e5b6 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063084:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834031.063087:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063102:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787834031.063105:0:17129:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063112:0:17129:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787834031.063117:0:17129:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834031.063122:0:17129:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787834031.063136:0:17129:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063142:0:17129:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787834031.063148:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063154:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e4eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e4f2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063169:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834031.063171:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834031.063172:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834031.063178:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834031.063187:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406180992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834031.063216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834031.063237:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787834031.063242:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406181120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834031.063776:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834031.063816:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406180992 00000100:00100000:3.0:1787834031.063821:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406180992 00010000:00010000:3.0:1787834031.063844:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5af expref: 18 pid: 17133 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834031.063866:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406181120 00000100:00100000:3.0:1787834031.063869:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406181120 00010000:00010000:3.0:1787834031.063880:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4eb expref: 19 pid: 17136 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834031.063893:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834031.063899:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:3640:x1874679406180992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834031.063924:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834031.063930:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5af expref: 19 pid: 17133 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063941:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5af expref: 19 pid: 17133 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.063957:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834031.063992:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:3640:x1874679406180992:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834031.063999:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834031.064015:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787834031.064021:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:3640:x1874679406181120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834031.064029:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834031.064033:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4eb expref: 18 pid: 17136 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064052:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4eb expref: 18 pid: 17136 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064063:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064071:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787834031.064084:0:17126:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006417157s 00010000:00010000:3.0:1787834031.064088:0:17126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064095:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064101:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064107:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064113:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834031.064116:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064123:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064132:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.064149:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834031.064173:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:3640:x1874679406181120:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834031.064179:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787834031.064216:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406181120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834031.064225:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406180992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834031.064256:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504ccd200/0x996d2fb20dc1e5b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e5af expref: 17 pid: 17133 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834031.065378:0:17157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406180736:0@lo:104: 00010000:00010000:3.0:1787834031.065408:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676600/0x996d2fb20dc1e4f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e4eb expref: 16 pid: 17136 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834031.065432:0:17157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406180864:0@lo:104: 00010000:00010000:3.0:1787834031.065453:0:17157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.065462:0:17157:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.065468:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834031.065473:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e5ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1787834031.072955:0:17873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787834031.073045:0:17898:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787834031.073050:0:17898:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787834031.073246:0:17899:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787834031.073633:0:17899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787834031.074378:0:17873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787834031.074744:0:17900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1874679406181248:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787834031.074834:0:17900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834031.074875:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406181248 00000100:00100000:3.0:1787834031.074881:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406181248 00000100:00100000:3.0:1787834031.074921:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787834031.074929:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17900:x1874679406181248:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787834031.075011:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17900:x1874679406181248:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834031.075018:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787834031.075045:0:17900:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605391600 going to sleep for 11 seconds 00000100:00100000:3.0:1787834031.075068:0:17900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1874679406181248:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787834031.075094:0:17900:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787834031.075118:0:17900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1874679406181376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787834031.075145:0:17900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834031.075163:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406181376 00000100:00100000:3.0:1787834031.075166:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406181376 00000100:00100000:3.0:1787834031.075187:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787834031.075193:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17900:x1874679406181376:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787834031.075482:0:17873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787834031.075523:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787834031.075965:0:17873:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787834031.075973:0:17873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787834031.076013:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834031.077791:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787834031.077876:0:17899:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1787834031.078788:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787834031.079311:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787834031.079348:0:17873:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787834031.079461:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787834031.080043:0:17873:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:3.0:1787834031.080353:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17900:x1874679406181376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 5156us (5203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834031.080365:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787834031.080406:0:17900:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605391600 going to sleep for 11 seconds 00000100:00100000:3.0:1787834031.080445:0:17900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1874679406181376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787834031.080526:0:17900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17900:1874679406181504:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787834031.080565:0:17900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834031.080593:0:17900:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605391e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787834031.081507:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406181504 00000100:00100000:0.0:1787834031.081977:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406181504 00000100:00100000:0.0:1787834031.082054:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787834031.082063:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17900:x1874679406181504:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787834031.082139:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17900:x1874679406181504:12345-0@lo:900:lod0001_rec0000.0 Request processed in 77us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834031.082145:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787834031.082202:0:17900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df502ec52c0 x1874679406181504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787834047 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834031.082229:0:17900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec52c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17900:1874679406181504:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787834031.082304:0:17900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1874679406181632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787834031.082340:0:17900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834031.082368:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406181632 00000100:00100000:2.0:1787834031.082372:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406181632 00000100:00100000:2.0:1787834031.082396:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834031.082401:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17900:x1874679406181632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787834031.082463:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17900:x1874679406181632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 61us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834031.082469:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834031.082487:0:17900:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e138c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787834031.082498:0:17900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1874679406181632:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787834031.082540:0:17900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834031.084665:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787834031.084744:0:17900:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787834031.084776:0:17900:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1787834031.086402:0:17873:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787834031.104806:0:17873:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787834031.104856:0:17873:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9fc9c17ab988 00100000:10000000:3.0:1787834031.104864:0:17873:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787834031.109962:0:17873:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787834031.109999:0:17873:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787834031.110018:0:17873:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787834031.110037:0:17873:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787834031.123857:0:17873:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834031.124116:0:17873:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787834031.446880:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:3.0:1787834031.894127:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787834032.088054:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787834032.478405:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 10000000:01000000:0.0:1787834032.795220:0:17138:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787834032.795227:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df611643000 from 8 10000000:01000000:0.0:1787834032.795231:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787834032.795274:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.795286:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.795296:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834032.795320:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406181760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787834032.795390:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834032.795450:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787834032.795476:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406181760 00000100:00100000:0.0:1787834032.795482:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406181760 00000100:00100000:0.0:1787834032.795524:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787834032.795532:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+16:17138:x1874679406181760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834032.795545:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834032.795557:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e5f5 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.795592:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5f5 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.795603:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5f5 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.795612:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676000, rc 0) 00000100:00100000:0.0:1787834032.795646:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406181760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834032.795653:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787834032.795696:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406181760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834032.795711:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.795719:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834032.795777:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406181888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787834032.795803:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834032.795821:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787834032.795832:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406181888 00000100:00100000:0.0:1787834032.795836:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406181888 00000100:00100000:0.0:1787834032.795856:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787834032.795861:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50458bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406181888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787834032.795873:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787834032.795888:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787834032.795897:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787834032.795968:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50458bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406181888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834032.795974:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787834032.796003:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406181888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787834032.796041:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787834032.796047:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.796056:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834032.796064:0:17138:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787834032.796067:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df504d9f000 from 8 10000000:01000000:0.0:1787834032.796070:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787834032.796084:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.796090:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.796097:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834032.796124:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406182016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787834032.796151:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834032.796164:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787834032.796175:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406182016 00000100:00100000:0.0:1787834032.796179:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406182016 00000100:00100000:0.0:1787834032.796207:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787834032.796213:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406182016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834032.796220:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834032.796228:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e603 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.796242:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e603 expref: 18 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.796250:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e603 expref: 18 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.796257:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677e00, rc 0) 00000100:00100000:0.0:1787834032.796293:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17138:x1874679406182016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834032.796299:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787834032.796328:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406182016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834032.796338:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.796345:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834032.796380:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406182144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787834032.796419:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834032.796432:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502469e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787834032.796442:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406182144 00000100:00100000:0.0:1787834032.796445:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406182144 00000100:00100000:0.0:1787834032.796468:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787834032.796473:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50458a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17138:x1874679406182144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787834032.796482:0:17133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787834032.796504:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787834032.796507:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787834032.796561:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50458a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17138:x1874679406182144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 87us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834032.796567:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787834032.796592:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406182144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787834032.796621:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787834032.796626:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834032.796634:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834032.917946:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787834033.122558:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787834033.493808:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:2.0:1787834033.947277:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834034.520004:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:3.0:1787834034.968902:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787834035.404569:0:18142:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787834035.544839:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 0 seconds 00010000:00010000:2.0:1787834035.990006:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834036.054057:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406182272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834036.054131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834036.054245:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406182272 00000100:00100000:0.0:1787834036.054253:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406182272 00000100:00100000:0.0:1787834036.054307:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787834036.054317:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406182272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787834036.054349:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787834036.054404:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406182272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834036.054411:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834036.054900:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406182272:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787834036.060571:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787834036.060577:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787834036.060581:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834036.060595:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df6187e2000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834036.060621:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502ec4000 x1874679406182528/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834036.060642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834036.060646:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834036.060649:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834036.060652:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834036.060670:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834036.060673:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834036.060676:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834036.060686:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787834036.060702:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787834036.060724:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406182656:0@lo:400:kworker.0 00000100:00100000:1.0:1787834036.060725:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406182400:0@lo:400:kworker.0 00000100:00100000:0.0:1787834036.060875:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406182528:0@lo:38:kworker.0 00000100:00100000:2.0:1787834036.064504:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406182784:0@lo:400:kworker.0 00000100:00100000:3.0:1787834036.068318:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834036.068318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834036.068889:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406182400 00000100:00100000:1.0:1787834036.068899:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406182400 00000100:00100000:1.0:1787834036.068956:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787834036.068966:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:3638:x1874679406182400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834036.069901:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:3638:x1874679406182400:12345-0@lo:400:kworker.0 Request processed in 934us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834036.069911:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787834036.070051:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406182400:0@lo:400:kworker.0 00000100:00100000:2.0:1787834036.075242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834036.075451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834036.075468:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406182656 00000100:00100000:1.0:1787834036.075479:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406182656 00000100:00100000:0.0:1787834036.075497:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406182528 00000100:00100000:0.0:1787834036.075502:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406182528 00000100:00100000:1.0:1787834036.075541:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406182784 00000100:00100000:1.0:1787834036.075545:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406182784 00000100:00100000:1.0:1787834036.075566:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787834036.075576:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406182656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834036.075585:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787834036.075593:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406182528:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787834036.075621:0:17146:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:3.0:1787834036.075659:0:17146:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1e611 00000004:00100000:3.0:1787834036.075674:0:17146:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787834036.075680:0:17146:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787834036.075768:0:17142:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787834036.075776:0:17142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787834036.075792:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787834036.075800:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787834036.075807:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406182784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834036.075875:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406182784:12345-0@lo:400:kworker.0 Request processed in 52us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834036.075884:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787834036.076070:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df502ec5680 x1874679406182784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834036.076085:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406182784:0@lo:400:kworker.0 00000100:00100000:1.0:1787834036.077324:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406182656:12345-0@lo:400:kworker.0 Request processed in 1746us (9009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834036.077337:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787834036.077515:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df502ec6580 x1874679406182656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834036.077542:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406182656:0@lo:400:kworker.0 00000100:00080000:0.0:1787834036.093475:0:17146:0:(import.c:65:import_set_state_nolock()) ffff8df6067d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787834036.093995:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874679406182528:12345-0@lo:38:kworker.0 Request processed in 18399us (18541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834036.094007:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787834036.094109:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787834036.094119:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787834036.094124:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787834036.094127:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787834036.094147:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005acaee47): req@ffff8df6212ff840 x1874679406175488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834036.094164:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406182528:0@lo:38:kworker.0 00000100:00100000:0.0:1787834036.094418:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834036.094450:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a75540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834036.094461:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787834036.094472:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406182912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834036.094495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834036.094664:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406175488 00000100:00100000:0.0:1787834036.094671:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406175488 00000100:00100000:0.0:1787834036.094801:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406182912 00000100:00100000:0.0:1787834036.094805:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406182912 00000100:00100000:0.0:1787834036.094820:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787834036.094827:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17183:x1874679406175488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787834036.094894:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17183:x1874679406175488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834036.094901:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787834036.094914:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787834036.094919:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406182912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787834036.094938:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834036.095112:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406182912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 191us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834036.095119:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787834036.095144:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212ff840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17183:1874679406175488:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787834036.095195:0:17183:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787834036.095226:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17183:1874679406183040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787834036.095266:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834036.095285:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602d8f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834036.095294:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406183040 00000100:00100000:0.0:1787834036.095297:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406183040 00000100:00100000:0.0:1787834036.095314:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787834036.095320:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17183:x1874679406183040:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787834036.095418:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17183:x1874679406183040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834036.095425:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787834036.095445:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17183:1874679406183040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787834036.095499:0:17183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17183:1874679406183168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787834036.095786:0:17183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834036.095802:0:17183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602d8f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834036.095816:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406183168 00000100:00100000:0.0:1787834036.095819:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406183168 00000100:00100000:0.0:1787834036.095836:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834036.095841:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17183:x1874679406183168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787834036.095884:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17183:x1874679406183168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 42us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834036.095890:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834036.095912:0:17183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17183:1874679406183168:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787834036.095958:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787834036.101143:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406182912:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787834036.103944:0:17183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787834036.104151:0:17183:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:0.0:1787834036.104156:0:17183:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1787834036.516630:0:18195:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834036.516997:0:18195:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787834037.014362:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787834037.497936:0:18246:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787834037.498189:0:18246:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787834038.037930:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787834038.479032:0:18295:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9e9ece00 20000000:00000080:0.0:1787834038.479052:0:18295:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df606690400 uarg=0000000000000000 20000000:01000000:0.0:1787834038.479089:0:18295:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787834038.479095:0:18295:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787834038.479101:0:18295:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787834038.479574:0:18296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787834038.483092:0:18295:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787834038.494910:0:18295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787834038.494937:0:18295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834038.494966:0:18295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e4ba expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834038.494974:0:18295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5bd expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834038.494982:0:18295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834038.495021:0:18295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e5bd expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834038.495035:0:18295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5bd expref: 17 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834038.495048:0:18295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18295:1874679406183296:0@lo:104: 00000100:00100000:3.0:1787834038.495105:0:18295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787834038.495160:0:18295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e4ba expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834038.495168:0:18295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ba expref: 17 pid: 17133 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834038.495177:0:18295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18295:1874679406183424:0@lo:104: 00000100:00100000:3.0:1787834038.495195:0:18295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834038.495206:0:18295:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605387c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787834038.495279:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406183296 00000100:00100000:1.0:1787834038.495286:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406183296 00000100:00100000:1.0:1787834038.495322:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406183424 00000100:00100000:1.0:1787834038.495325:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406183424 00000100:00100000:1.0:1787834038.495340:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787834038.495348:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:18295:x1874679406183296:12345-0@lo:104: 00010000:00010000:1.0:1787834038.495360:0:17124:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495430:0:17124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787834038.495437:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:18295:x1874679406183296:12345-0@lo:104: Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834038.495443:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787834038.495459:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787834038.495465:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:18295:x1874679406183424:12345-0@lo:104: 00010000:00010000:1.0:1787834038.495472:0:17124:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495509:0:17124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787834038.495514:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:18295:x1874679406183424:12345-0@lo:104: Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834038.495519:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787834038.495535:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787834038.495540:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495547:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccca00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787834038.495551:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495559:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787834038.495566:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834038.495572:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787834038.495601:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495608:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787834038.495627:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495634:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e5bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e5c4 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495657:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834038.495660:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495665:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787834038.495667:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495673:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787834038.495679:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834038.495684:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787834038.495696:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495702:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787834038.495716:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495722:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e4ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e4c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495733:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834038.495735:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834038.495737:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834038.495747:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406183552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787834038.495798:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834038.495831:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406183680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787834038.495853:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834038.495892:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406183552 00000100:00100000:1.0:1787834038.495896:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406183552 00010000:00010000:1.0:1787834038.495912:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5bd expref: 18 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834038.495929:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406183680 00000100:00100000:1.0:1787834038.495931:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406183680 00010000:00010000:1.0:1787834038.495940:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ba expref: 19 pid: 17133 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834038.495950:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787834038.495955:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:3639:x1874679406183552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834038.495963:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834038.495967:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5bd expref: 19 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495976:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5bd expref: 19 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.495989:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834038.496014:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:3639:x1874679406183552:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834038.496019:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787834038.496032:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787834038.496038:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:3640:x1874679406183680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834038.496045:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834038.496054:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ba expref: 18 pid: 17133 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496061:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ba expref: 18 pid: 17133 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496072:0:17127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496079:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496090:0:17127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496097:0:17127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496103:0:17127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496109:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496115:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834038.496119:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496126:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496135:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834038.496151:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834038.496180:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:3640:x1874679406183680:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834038.496186:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787834038.496219:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406183680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787834038.496243:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406183552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834038.496393:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e5c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e5bd expref: 17 pid: 17136 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834038.496416:0:18295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18295:1874679406183296:0@lo:104: 00010000:00010000:3.0:1787834038.496428:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e4c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e4ba expref: 16 pid: 17133 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834038.496435:0:18295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18295:1874679406183424:0@lo:104: 00010000:00010000:3.0:1787834038.496449:0:18295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834038.496457:0:18295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834038.496463:0:18295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834038.496469:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e618 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834038.497846:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834039.067199:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834039.574446:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787834040.087291:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834040.152987:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834030/real 1787834030] req@ffff8df50250a940 x1874679406178560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834040.153017:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df50250a940 x1874679406178560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834040.153028:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834030/real 1787834030] req@ffff8df50250a1c0 x1874679406178432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834040.153038:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df50250a1c0 x1874679406178432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787834040.153057:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834040.153084:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834040.153089:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406178560:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787834040.153094:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df602ac8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834040.153099:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834040.153101:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406178432:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787834040.153221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834040.153225:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834040.153236:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834040.153239:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834040.153256:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834040.153259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787834040.153261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df602ac8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787834040.153266:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1787834040.153271:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787834040.153278:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df602ac8800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834040.153295:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212fde00 x1874679406184320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787834040.153311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834040.153313:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787834040.153315:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787834040.153317:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1787834040.153320:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787834040.153323:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df635806800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834040.153332:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212fe940 x1874679406184448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787834040.153514:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406183808:0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.153584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834040.153627:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406184576:0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.153652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834040.153675:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787834040.153680:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406184192:0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.153705:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834040.153731:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406183936:0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.153779:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834040.153793:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787834040.153798:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406184064:0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.153816:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834040.153840:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406184192 00000100:00100000:1.0:1787834040.153845:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406184192 00000100:00100000:1.0:1787834040.153874:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406183936 00000100:00100000:1.0:1787834040.153875:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406183936 00000100:00100000:1.0:1787834040.153888:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787834040.153895:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406184192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.154054:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406184192:12345-0@lo:400:kworker.0 Request processed in 157us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834040.154062:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787834040.154078:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787834040.154084:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874679406183936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.154114:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874679406183936:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834040.154119:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787834040.154135:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406184576 00000100:00100000:1.0:1787834040.154144:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406184576 00000100:00100000:1.0:1787834040.154169:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406184064 00000100:00100000:1.0:1787834040.154171:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406184064 00000100:00100000:1.0:1787834040.154187:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787834040.154193:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406184576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.154223:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406184576:12345-0@lo:400:kworker.0 Request processed in 31us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834040.154287:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787834040.154298:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834040.154304:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406184064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.154330:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406184064:12345-0@lo:400:kworker.0 Request processed in 27us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834040.154334:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787834040.154375:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6212ff840 x1874679406184064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834040.154386:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406184064:0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.154396:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406183936:0@lo:400:kworker.0 00000100:00100000:1.0:1787834040.154428:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406184320:0@lo:8:kworker.0 00000400:00000100:1.0:1787834040.154450:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406184320 offset 0 length 520: 4 00000100:00100000:1.0:1787834040.154469:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406184448:0@lo:8:kworker.0 00000400:00000100:1.0:1787834040.154489:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406184448 offset 0 length 520: 4 00000100:00100000:2.0:1787834040.154596:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406183808 00000100:00100000:2.0:1787834040.154600:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406183808 00000100:00100000:2.0:1787834040.154631:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787834040.154637:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50458b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+16:3641:x1874679406183808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834040.156804:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406184192:0@lo:400:kworker.0 00010000:00080000:0.0:1787834040.156826:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6212fed00 x1874679406184576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834040.156838:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406184576:0@lo:400:kworker.0 00000100:00100000:2.0:1787834040.173277:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50458b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+16:3641:x1874679406183808:12345-0@lo:400:kworker.0 Request processed in 18629us (19682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834040.173292:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787834040.173648:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406183808:0@lo:400:kworker.0 10000000:01000000:0.0:1787834040.536813:0:17138:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787834040.536820:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df611643000 from 13 10000000:01000000:0.0:1787834040.536825:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787834040.536866:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834040.536877:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834040.536888:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834040.536989:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406184704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787834040.537057:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834040.537198:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602d8f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834040.537222:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406184704 00000100:00100000:0.0:1787834040.537236:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406184704 00000100:00100000:0.0:1787834040.537292:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787834040.537303:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+16:17138:x1874679406184704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834040.537317:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834040.537331:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e61f expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834040.537370:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e61f expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834040.537382:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e61f expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834040.537391:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676c00, rc 0) 00000100:00100000:0.0:1787834040.537437:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406184704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834040.537446:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787834040.537496:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406184704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834040.537510:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834040.537518:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834040.537575:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406184832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834040.537597:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834040.537896:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406184832 00000100:00100000:3.0:1787834040.537901:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406184832 00000100:00100000:3.0:1787834040.537930:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787834040.537938:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406184832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834040.538280:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406184832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834040.538289:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787834040.539018:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602d8f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834040.539044:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406184832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834040.539107:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406184960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787834040.539166:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834040.539195:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602d8f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787834040.541218:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406184960 00000100:00100000:2.0:1787834040.541231:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406184960 00000100:00100000:2.0:1787834040.541289:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787834040.541299:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406184960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787834040.541467:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406184960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834040.541475:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787834040.541555:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406184960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787834040.551363:0:18411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787834040.551541:0:17138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787834040.551574:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787834040.551585:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834040.551596:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834040.551605:0:17138:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787834040.551608:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df504d9f000 from 13 10000000:01000000:2.0:1787834040.551611:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787834040.551658:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834040.551666:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834040.551676:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834040.551700:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406185088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787834040.551845:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834040.552011:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406185088 00000100:00100000:3.0:1787834040.552018:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406185088 00000100:00100000:3.0:1787834040.552103:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787834040.552112:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+17:17138:x1874679406185088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834040.552124:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834040.552137:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e62d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834040.552159:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e62d expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834040.552169:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e62d expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834040.552178:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031a00, rc 0) 00000100:00100000:3.0:1787834040.552232:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17138:x1874679406185088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834040.552239:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787834040.552432:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787834040.552454:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406185088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834040.552468:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834040.552477:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834040.552534:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504600780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406185216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834040.552560:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834040.552620:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834040.552655:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406185216 00000100:00100000:2.0:1787834040.552659:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406185216 00000100:00100000:2.0:1787834040.552727:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787834040.552736:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17138:x1874679406185216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787834040.552882:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17138:x1874679406185216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834040.552891:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787834040.553003:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504600780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406185216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834040.553038:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504600780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406185344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787834040.553078:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834040.553107:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834040.553336:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406185344 00000100:00100000:2.0:1787834040.553340:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406185344 00000100:00100000:2.0:1787834040.553373:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787834040.553380:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17138:x1874679406185344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787834040.553472:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:17138:x1874679406185344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834040.553479:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787834040.553562:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504600780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406185344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787834040.555403:0:18413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787834040.555611:0:17138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787834040.555641:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787834040.555652:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834040.555664:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834041.112734:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834041.174101:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787834041.174124:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406185472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834041.174196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834041.177348:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406185472 00000100:00100000:0.0:1787834041.177371:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406185472 00000100:00100000:0.0:1787834041.177427:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787834041.177436:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406185472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787834041.177472:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787834041.177556:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406185472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (3360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834041.177562:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787834041.177616:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406185472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834041.178201:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834026/real 1787834026] req@ffff8df502ec4780 x1874679406176512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834041 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834041.178221:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df502ec4780 x1874679406176512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834041 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834041.178238:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834026/real 1787834026] req@ffff8df502ec43c0 x1874679406176640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834041 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834041.178249:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df502ec43c0 x1874679406176640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834041 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787834041.178264:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df50454a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834041.178286:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787834041.178290:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406176512:0@lo:8:kworker.0 00000100:00080000:2.0:1787834041.178294:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df63fb42000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834041.178299:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787834041.178301:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406176640:0@lo:8:kworker.0 00000100:00080000:3.0:1787834041.178427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834041.178432:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787834041.178435:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df50454a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834041.178439:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:3.0:1787834041.178443:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787834041.178449:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df50454a800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834041.178467:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df504601a40 x1874679406185856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834041.178478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834041.178481:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787834041.178483:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df63fb42000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834041.178486:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:3.0:1787834041.178488:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787834041.178491:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df63fb42000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834041.178501:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df504603c00 x1874679406185984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834041.178516:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834041.178520:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834041.178528:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834041.178531:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787834041.178558:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406185728:0@lo:400:kworker.0 00000100:00100000:3.0:1787834041.178605:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834041.178634:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787834041.178640:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504602940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406186112:0@lo:400:kworker.0 00000100:00100000:3.0:1787834041.178663:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834041.178691:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406186112 00000100:00100000:3.0:1787834041.178697:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406186112 00000100:00100000:3.0:1787834041.178733:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787834041.178740:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406186112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834041.178800:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406186112:12345-0@lo:400:kworker.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834041.178807:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787834041.178841:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df504602940 x1874679406186112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834041.178851:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504602940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406186112:0@lo:400:kworker.0 00000100:00100000:2.0:1787834041.178916:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406186240:0@lo:400:kworker.0 00000100:00100000:2.0:1787834041.178944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834041.178970:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787834041.178975:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504603840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406185600:0@lo:400:kworker.0 00000100:00100000:2.0:1787834041.179002:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834041.179036:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406185600 00000100:00100000:2.0:1787834041.179040:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406185600 00000100:00100000:2.0:1787834041.179065:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787834041.179195:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406186240 00000100:00100000:3.0:1787834041.179199:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406186240 00000100:00100000:3.0:1787834041.179222:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787834041.179228:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406186240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834041.179264:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406186240:12345-0@lo:400:kworker.0 Request processed in 36us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834041.179271:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834041.179313:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:3638:x1874679406185600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834041.179345:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:3638:x1874679406185600:12345-0@lo:400:kworker.0 Request processed in 274us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834041.179361:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787834041.179394:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406185856:0@lo:8:kworker.0 00000400:00000100:2.0:1787834041.179426:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406185856 offset 0 length 520: 4 00000100:00100000:2.0:1787834041.179439:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504603c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406185984:0@lo:8:kworker.0 00000400:00000100:2.0:1787834041.179456:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406185984 offset 0 length 520: 4 00000100:00100000:2.0:1787834041.179484:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504603840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406185600:0@lo:400:kworker.0 00010000:00080000:2.0:1787834041.179495:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df5046030c0 x1874679406186240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834041.179504:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406186240:0@lo:400:kworker.0 00000100:00100000:2.0:1787834041.183450:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406186368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834041.183524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834041.183599:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406185728 00000100:00100000:0.0:1787834041.183607:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406185728 00000100:00100000:0.0:1787834041.183643:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406186368 00000100:00100000:0.0:1787834041.183646:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406186368 00000100:00100000:0.0:1787834041.183661:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787834041.183669:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1874679406185728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834041.183731:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1874679406185728:12345-0@lo:400:kworker.0 Request processed in 62us (5125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834041.183737:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787834041.183776:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787834041.183783:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406186368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787834041.183806:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834041.188871:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406186368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5079us (5338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834041.188893:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787834041.188966:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406185728:0@lo:400:kworker.0 00000100:00100000:2.0:1787834041.190173:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406186368:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787834042.136391:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787834042.200065:0:17874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787834043.158262:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834043.353532:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787834044.183658:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787834044.316091:0:18643:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787834044.316095:0:18643:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787834044.316096:0:18643:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787834044.316987:0:18643:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df63435b800 00000020:01000004:1.0:1787834044.317004:0:18643:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787834044.317017:0:18643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787834044.317037:0:18643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8df60346b490) 00000020:00000080:1.0:1787834044.317053:0:18643:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787834044.396546:0:18643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787834044.405894:0:18643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787834044.406439:0:18643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787834044.406893:0:18643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787834044.407160:0:18643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787834044.407497:0:18643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787834044.407741:0:18643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1787834044.412698:0:18643:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787834044.413106:0:18643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787834044.413118:0:18643:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787834044.413132:0:18643:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x996d2fb20dc1e642 00000020:01000004:2.0:1787834044.413139:0:18643:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787834044.414438:0:18643:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787834044.414444:0:18643:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787834044.414452:0:18643:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787834044.414460:0:18643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787834044.414475:0:18643:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8df62ea93490) 00000020:00000080:2.0:1787834044.414493:0:18643:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787834044.420659:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787834044.425906:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787834044.425915:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787834044.427092:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787834044.427112:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787834044.427726:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787834044.427735:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787834044.439818:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834044.440006:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787834044.440013:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787834044.444085:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787834044.444098:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787834044.490887:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787834044.491256:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787834044.491264:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787834044.492891:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787834044.492903:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787834044.494105:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787834044.494117:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787834044.498549:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787834044.499446:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787834044.499452:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787834044.509912:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787834044.509928:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787834044.569498:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787834044.569704:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787834044.569711:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787834044.572417:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787834044.572431:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787834044.573249:0:18643:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787834044.573277:0:18643:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787834044.573283:0:18643:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787834044.585166:0:18643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787834044.585364:0:18643:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787834044.585369:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787834044.585371:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787834044.585372:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834044.585373:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834044.585374:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834044.585375:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834044.585377:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787834044.585379:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834044.585381:0:18643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787834044.585384:0:18643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787834044.585386:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787834044.585387:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787834044.585389:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834044.585390:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834044.585391:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834044.585392:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834044.585393:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787834044.585394:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834044.585395:0:18643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787834044.585422:0:18643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787834044.585447:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406186496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787834044.585520:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.585807:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df61a660300 going to sleep for 11 seconds 00000100:00100000:0.0:1787834044.587376:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406186496 00000100:00100000:0.0:1787834044.587386:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406186496 00000100:00100000:1.0:1787834044.587611:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787834044.587621:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502517850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:18643:x1874679406186496:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787834044.587715:0:17133:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787834044.587719:0:17133:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787834044.587722:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787834044.590504:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502517850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:18643:x1874679406186496:12345-0@lo:253:mount.lustre.0 Request processed in 2875us (4974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834044.590519:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787834044.590783:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406186496:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787834044.590798:0:18643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787834044.590801:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787834044.590803:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787834044.590804:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787834044.590805:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787834044.590807:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787834044.590808:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787834044.590810:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787834044.590811:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787834044.590813:0:18643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787834044.590836:0:18643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df63435b800 from lustre-OST0000 10000000:01000000:1.0:1787834044.590868:0:18643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787834044.590872:0:18643:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787834044.590879:0:18643:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df503f10000 local copy 00010000:00010000:1.0:1787834044.590890:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834044.590993:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406186624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834044.591064:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834044.591098:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834044.591200:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406186624 00000100:00100000:2.0:1787834044.591205:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406186624 00000100:00100000:2.0:1787834044.591249:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787834044.591258:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:18643:x1874679406186624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834044.591346:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:18643:x1874679406186624:12345-0@lo:501:mount.lustre.0 Request processed in 90us (282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787834044.591353:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787834044.594486:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406186624:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787834044.594526:0:18643:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787834044.594579:0:18643:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787834044.594589:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.594599:0:18643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834044.594627:0:18643:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df63435b800 10000000:01000000:3.0:1787834044.594633:0:18643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787834044.594638:0:18643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787834044.594641:0:18643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787834044.594645:0:18643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787834044.594648:0:18643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787834044.594682:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.594992:0:18643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.595004:0:18643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834044.595109:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406186752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787834044.595170:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834044.595213:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df601254240 going to sleep for 11 seconds 00000100:00100000:2.0:1787834044.595242:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406186752 00000100:00100000:2.0:1787834044.595249:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406186752 00000100:00100000:2.0:1787834044.595304:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787834044.595313:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502514c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+18:18643:x1874679406186752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834044.595336:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834044.595349:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504ccc800/0x996d2fb20dc1e657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e650 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.595374:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504ccc800/0x996d2fb20dc1e657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e650 expref: 19 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.595384:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504ccc800/0x996d2fb20dc1e657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e650 expref: 19 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.595392:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccc800, rc 0) 00000100:00100000:2.0:1787834044.595451:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502514c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406186752:12345-0@lo:101:mount.lustre.0 Request processed in 139us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834044.595458:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787834044.595584:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406186752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834044.595598:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.595606:0:18643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787834044.597162:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787834044.598271:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787834044.602068:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787834044.602163:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787834044.602190:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787834044.602205:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787834044.602219:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787834044.602235:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787834044.602263:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787834044.602270:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787834044.602386:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406186880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834044.602453:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834044.602499:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df601254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787834044.602744:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406186880 00000100:00100000:1.0:1787834044.602784:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406186880 00000100:00100000:1.0:1787834044.602834:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787834044.602843:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406186880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834044.602997:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406186880:12345-0@lo:501:mount.lustre.0 Request processed in 155us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834044.603005:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787834044.603286:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406186880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834044.603320:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834044.603375:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834044.603410:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df601254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787834044.603457:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406187008 00000100:00100000:0.0:1787834044.603462:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406187008 00000100:00100000:0.0:1787834044.603494:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787834044.603501:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406187008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834044.604343:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406187008:12345-0@lo:503:mount.lustre.0 Request processed in 839us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834044.604353:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787834044.604466:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787834044.605142:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787834044.605292:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834044.605354:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834044.605543:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df601254240 going to sleep for 11 seconds 00000100:00100000:2.0:1787834044.607229:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406187136 00000100:00100000:2.0:1787834044.607241:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406187136 00000100:00100000:2.0:1787834044.607479:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787834044.607489:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406187136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834044.608259:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406187136:12345-0@lo:502:mount.lustre.0 Request processed in 769us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834044.608269:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787834044.608375:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787834044.608599:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787834044.608644:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787834044.608662:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787834044.608678:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787834044.608694:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787834044.608710:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787834044.608726:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787834044.608741:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787834044.608791:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787834044.608808:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787834044.608824:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787834044.608839:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787834044.608883:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834044.608931:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834044.608964:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df601254240 going to sleep for 11 seconds 00000100:00100000:2.0:1787834044.609252:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406187264 00000100:00100000:2.0:1787834044.609258:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406187264 00000100:00100000:2.0:1787834044.609298:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787834044.609307:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406187264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834044.609431:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406187264:12345-0@lo:502:mount.lustre.0 Request processed in 115us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834044.609439:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787834044.609516:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787834044.609572:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787834044.609582:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787834044.610684:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787834044.610694:0:18660:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787834044.610700:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834044.610702:0:18660:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787834044.610709:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787834044.610725:0:18660:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8df635429a48) 00000020:00000080:0.0:1787834044.610776:0:18660:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787834044.610784:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787834044.610895:0:18660:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df63435b800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787834044.610904:0:18660:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787834044.610911:0:18660:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x996d2fb20dc1e665 00010000:00010000:0.0:1787834044.621831:0:18660:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787834044.623905:0:18660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1787834044.631709:0:18660:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787834044.633547:0:18660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787834044.633560:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787834044.633567:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834044.633569:0:18660:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787834044.633573:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787834044.633576:0:18660:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1787834044.633577:0:18660:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787834044.633579:0:18660:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787834044.633580:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787834044.633582:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834044.633584:0:18660:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787834044.633586:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787834044.633589:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834044.633591:0:18660:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787834044.633594:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787834044.633596:0:18660:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787834044.633598:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787834044.633600:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834044.633601:0:18660:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787834044.633604:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787834044.633606:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834044.633607:0:18660:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787834044.633611:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787834044.633637:0:18660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787834044.633640:0:18660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787834044.633641:0:18660:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787834044.633644:0:18660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787834044.633830:0:18643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787834044.633862:0:18643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787834044.633885:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.633897:0:18643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834044.633906:0:18643:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63435b800 from 1 10000000:01000000:2.0:1787834044.633909:0:18643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787834044.633941:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.633956:0:18643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.633969:0:18643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834044.634005:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834044.634069:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.634114:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a756c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834044.634277:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406187392 00000100:00100000:0.0:1787834044.634285:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406187392 00000100:00100000:0.0:1787834044.634347:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787834044.634357:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:18643:x1874679406187392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834044.634389:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834044.634402:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e66c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834044.634427:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e66c expref: 20 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834044.634438:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e66c expref: 20 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834044.634446:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677000, rc 0) 00000100:00100000:0.0:1787834044.634486:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406187392:12345-0@lo:101:mount.lustre.0 Request processed in 131us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834044.634494:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787834044.634849:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834044.634863:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.634871:0:18643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787834044.635894:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787834044.636494:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834044.636704:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787834044.636730:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787834044.637472:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787834044.637484:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787834044.637576:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834044.637640:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.637726:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df621399300 going to sleep for 11 seconds 00000100:00100000:0.0:1787834044.640808:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406187520 00000100:00100000:0.0:1787834044.640821:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406187520 00000100:00100000:0.0:1787834044.640948:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787834044.640959:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502515050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406187520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834044.641269:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502515050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406187520:12345-0@lo:501:mount.lustre.0 Request processed in 310us (3627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834044.641276:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787834044.648819:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834044.648878:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834044.648958:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.649010:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df621399300 going to sleep for 11 seconds 00000100:00100000:3.0:1787834044.649152:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406187648 00000100:00100000:3.0:1787834044.649159:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406187648 00000100:00100000:3.0:1787834044.649490:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787834044.649508:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406187648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834044.649633:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406187648:12345-0@lo:503:mount.lustre.0 Request processed in 127us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834044.649641:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787834044.650098:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187648:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787834044.650541:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787834044.650614:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834044.650666:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.650917:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e181540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834044.650999:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406187776 00000100:00100000:0.0:1787834044.651005:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406187776 00000100:00100000:0.0:1787834044.651037:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787834044.651045:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406187776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834044.651183:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406187776:12345-0@lo:502:mount.lustre.0 Request processed in 138us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834044.651201:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787834044.653261:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787834044.653678:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787834044.653713:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787834044.653731:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787834044.653747:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787834044.653794:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787834044.653810:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787834044.653824:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787834044.653839:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1787834044.653853:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787834044.653867:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1787834044.653895:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1787834044.653930:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834044.654037:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.654078:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834044.654144:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406187904 00000100:00100000:3.0:1787834044.654150:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406187904 00000100:00100000:3.0:1787834044.654196:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787834044.654205:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406187904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834044.654311:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406187904:12345-0@lo:502:mount.lustre.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834044.654319:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787834044.654445:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406187904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787834044.654485:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1787834044.654493:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787834044.655266:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834044.655275:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834044.655278:0:18664:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787834044.655286:0:18664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df63435b800 00000020:00000080:3.0:1787834044.655288:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834044.655297:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834044.655300:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834044.655301:0:18664:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787834044.655303:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834044.655306:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834044.655307:0:18664:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787834044.655310:0:18664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df63435b800 00000020:00000080:3.0:1787834044.655312:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834044.655469:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834044.655473:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834044.655475:0:18664:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787834044.655478:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834044.655481:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834044.655482:0:18664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834044.655492:0:18664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df63435b800 00000020:00000080:3.0:1787834044.655494:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834044.656054:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834044.656060:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834044.656061:0:18664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834044.656064:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834044.656067:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834044.656069:0:18664:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787834044.656072:0:18664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df63435b800 00000020:00000080:3.0:1787834044.656074:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834044.656103:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834044.656107:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834044.656108:0:18664:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787834044.656111:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787834044.656241:0:18643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787834044.656271:0:18643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787834044.656283:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834044.656293:0:18643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834044.656355:0:18643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787834044.656358:0:18643:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df63435b800 10000000:01000000:0.0:1787834044.656361:0:18643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df63435b800 10000000:01000000:0.0:1787834044.656365:0:18643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787834044.656380:0:18643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df63435b800 from 1 10000000:01000000:0.0:1787834044.656384:0:18643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787834044.656415:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834044.656423:0:18643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834044.656433:0:18643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834044.656453:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787834044.656506:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834044.656549:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787834044.656743:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406188032 00000100:00100000:3.0:1787834044.656784:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406188032 00000100:00100000:3.0:1787834044.656827:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787834044.656836:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:18643:x1874679406188032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834044.656849:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834044.656861:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e67a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.656883:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e67a expref: 21 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.656894:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e67a expref: 21 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.656902:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030800, rc 0) 00000100:00100000:3.0:1787834044.656941:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188032:12345-0@lo:101:mount.lustre.0 Request processed in 107us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834044.656959:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787834044.657044:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834044.657058:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.657073:0:18643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787834044.659883:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787834044.660166:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834044.660479:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787834044.660504:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787834044.660518:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787834044.660531:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787834044.660546:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787834044.660559:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787834044.660571:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787834044.660585:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787834044.660597:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787834044.660609:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787834044.660622:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787834044.660635:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787834044.660662:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787834044.660679:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787834044.660692:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787834044.660702:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787834044.660714:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787834044.660726:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787834044.660737:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787834044.660933:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787834044.660957:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787834044.660970:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787834044.660983:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787834044.660996:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787834044.661007:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787834044.661019:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787834044.661042:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787834044.661054:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787834044.661079:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787834044.661095:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787834044.661108:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787834044.661122:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787834044.661133:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787834044.661145:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787834044.661158:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787834044.661182:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787834044.661199:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787834044.661221:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787834044.661226:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787834044.661311:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834044.661446:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834044.661486:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834044.661590:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406188160 00000100:00100000:3.0:1787834044.661597:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406188160 00000100:00100000:3.0:1787834044.661647:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787834044.661655:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834044.661775:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188160:12345-0@lo:501:mount.lustre.0 Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834044.661783:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787834044.661801:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834044.661838:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834044.661885:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834044.661915:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787834044.662007:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406188288 00000100:00100000:3.0:1787834044.662011:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406188288 00000100:00100000:3.0:1787834044.662040:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787834044.662047:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188288:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834044.662136:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188288:12345-0@lo:503:mount.lustre.0 Request processed in 88us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834044.662143:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787834044.662292:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787834044.662715:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787834044.662805:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834044.662843:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834044.662870:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406188416 00000100:00100000:0.0:1787834044.662874:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406188416 00000100:00100000:0.0:1787834044.662902:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787834044.662909:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834044.662983:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188416:12345-0@lo:502:mount.lustre.0 Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834044.662990:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787834044.663024:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787834044.663038:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787834044.663215:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787834044.663239:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787834044.663253:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787834044.663267:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787834044.663280:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787834044.663292:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787834044.663305:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787834044.663319:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787834044.663343:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787834044.663357:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787834044.664466:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787834044.664501:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787834044.664517:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787834044.664557:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787834044.664573:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787834044.664587:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787834044.664722:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787834044.664743:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787834044.665289:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787834044.665311:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787834044.665338:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787834044.665356:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787834044.665448:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787834044.665470:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787834044.665485:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787834044.665498:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787834044.665510:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787834044.665523:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787834044.665536:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787834044.665550:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787834044.665562:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787834044.665575:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787834044.665601:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787834044.665616:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787834044.665639:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787834044.665652:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787834044.665665:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787834044.665678:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787834044.665690:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787834044.665703:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787834044.665715:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787834044.665729:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787834044.665742:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787834044.667694:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787834044.667741:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787834044.667772:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787834044.667787:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787834044.667801:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787834044.667886:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834044.667974:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834044.668035:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787834044.670288:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406188544 00000100:00100000:2.0:1787834044.670302:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406188544 00000100:00100000:2.0:1787834044.670372:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787834044.670382:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834044.670539:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188544:12345-0@lo:502:mount.lustre.0 Request processed in 157us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834044.670547:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787834044.670616:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787834044.670825:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787834044.670851:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787834044.670883:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834044.670922:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.670954:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787834044.671088:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406188672 00000100:00100000:1.0:1787834044.671094:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406188672 00000100:00100000:1.0:1787834044.671132:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787834044.671139:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834044.671296:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406188672:12345-0@lo:502:mount.lustre.0 Request processed in 156us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834044.671303:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787834044.671617:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406188672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787834044.671666:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787834044.671675:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787834044.672594:0:18669:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787834044.672610:0:18669:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df63542b490) 00000020:00000080:0.0:1787834044.672632:0:18669:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787834044.672715:0:18669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df63435b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787834044.672720:0:18669:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63435b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787834044.672722:0:18669:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63435b800 3 00010000:00080000:0.0:1787834044.672797:0:18669:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df6067d4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.117@tcp at head 00010000:00010000:2.0:1787834044.675992:0:18669:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787834044.680912:0:18669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787834044.680966:0:18669:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787834044.680978:0:18669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x996d2fb20dc1e68f 00000100:00080000:2.0:1787834044.680990:0:18669:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787834044.680996:0:18669:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df6067d4000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834044.681031:0:18669:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6212ff840 x1874679406188800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787834044.681072:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406188800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787834044.681142:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.681881:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406188800 00000100:00100000:2.0:1787834044.681889:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406188800 00000100:00100000:2.0:1787834044.681924:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787834044.681931:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406188800:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787834044.681953:0:17143:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:2.0:1787834044.681985:0:17143:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x996d2fb20dc1e696 00000004:00100000:2.0:1787834044.682001:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787834044.682030:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8df503f61800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834044.682087:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874679406188800:12345-0@lo:38:llog_process_th.0 Request processed in 155us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834044.682095:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787834044.682134:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6212ff840 x1874679406188800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834044.682145:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787834044.682152:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787834044.682158:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787834044.682162:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787834044.682165:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6067d4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787834044.682170:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406188800:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787834044.682839:0:18669:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:3.0:1787834044.683160:0:18669:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787834044.683497:0:18669:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8df5039b9a48) 00000020:00000080:3.0:1787834044.683520:0:18669:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787834044.683598:0:18669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df63435b800 from lustre-OST0000, refs=3 00000100:00080000:0.0:1787834044.683598:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000004:3.0:1787834044.683601:0:18669:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63435b800 from lustre-OST0000, refs=3 00000100:00080000:0.0:1787834044.683602:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1787834044.683605:0:18669:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63435b800 3 00000100:00080000:0.0:1787834044.683605:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834044.683608:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1787834044.683632:0:18669:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df60343d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.117@tcp at head 00000100:00080000:0.0:1787834044.683634:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834044.683637:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834044.683639:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834044.683641:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787834044.683695:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406188928:0@lo:400:kworker.0 00000100:00100000:0.0:1787834044.683746:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834044.683796:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787834044.683802:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406189056:0@lo:400:kworker.0 00000100:00100000:0.0:1787834044.683827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834044.683859:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406189056 00000100:00100000:0.0:1787834044.683865:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406189056 00000100:00100000:0.0:1787834044.683903:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787834044.683912:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406189056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834044.683957:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406189056:12345-0@lo:400:kworker.0 Request processed in 46us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834044.683963:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787834044.684277:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406189184:0@lo:400:kworker.0 00000100:00100000:2.0:1787834044.684293:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406189312:0@lo:400:kworker.0 00010000:00010000:3.0:1787834044.686148:0:18669:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1787834044.688008:0:18669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787834044.688069:0:18669:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787834044.688084:0:18669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x996d2fb20dc1e6a4 00000100:00080000:3.0:1787834044.688097:0:18669:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787834044.688116:0:18669:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8df60343d800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834044.688155:0:18669:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df5046012c0 x1874679406189440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:0.0:1787834044.688219:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df635a99e00 x1874679406189056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834044.688235:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406189056:0@lo:400:kworker.0 00000100:00080000:3.0:1787834044.688241:0:18669:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787834044.688273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834044.688278:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834044.688281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834044.688284:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834044.688287:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834044.688289:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834044.688292:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834044.688294:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787834044.688515:0:18669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:3.0:1787834044.688895:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406189440:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787834044.688957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.690709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834044.690741:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406189440 00000020:01000000:2.0:1787834044.690772:0:18643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787834044.690810:0:18643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787834044.690835:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.690846:0:18643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834044.690876:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406189440 00000020:01000004:2.0:1787834044.690900:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787834044.690906:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787834044.690907:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834044.690908:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834044.690909:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:3.0:1787834044.690910:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406189312 00000020:01000004:2.0:1787834044.690911:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834044.690912:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:3.0:1787834044.690913:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406189312 00000020:01000004:2.0:1787834044.690914:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834044.690915:0:18643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787834044.690919:0:18643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787834044.690921:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787834044.690922:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787834044.690923:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834044.690924:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834044.690925:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834044.690926:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834044.690926:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787834044.690927:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834044.690928:0:18643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787834044.690938:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834044.690945:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406189312:12345-0@lo:400:kworker.0 10000000:01000000:2.0:1787834044.690951:0:18643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787834044.690963:0:18643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406189568:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787834044.690996:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406189312:12345-0@lo:400:kworker.0 Request processed in 51us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834044.691003:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834044.691019:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787834044.691023:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504602580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874679406189440:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787834044.691119:0:18167:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1787834044.691150:0:18167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x996d2fb20dc1e6ab 00000004:00100000:3.0:1787834044.691163:0:18167:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787834044.691264:0:18167:0:(import.c:65:import_set_state_nolock()) ffff8df603438000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834044.691292:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834044.691306:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504602580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874679406189440:12345-0@lo:38:llog_process_th.0 Request processed in 281us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834044.691313:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787834044.691359:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df5046012c0 x1874679406189440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834044.691411:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406188928 00000100:00100000:1.0:1787834044.691417:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406188928 00000100:00100000:1.0:1787834044.691437:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406189184 00000100:00100000:3.0:1787834044.691442:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1787834044.691445:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406189184 00000100:00080000:3.0:1787834044.691450:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787834044.691458:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:1.0:1787834044.691459:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787834044.691462:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00100000:1.0:1787834044.691464:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406188928:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787834044.691465:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df60343d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787834044.691471:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406189440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787834044.691502:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406188928:12345-0@lo:400:kworker.0 Request processed in 38us (7756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834044.691509:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787834044.691521:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787834044.691526:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406189184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834044.691551:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406189184:12345-0@lo:400:kworker.0 Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834044.691557:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787834044.691601:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834044.691602:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406189184:0@lo:400:kworker.0 00000100:00100000:2.0:1787834044.691635:0:18643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27d80 going to sleep for 11 seconds 00010000:00080000:2.0:1787834044.691663:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df635a98b40 x1874679406189312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834044.691674:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406189312:0@lo:400:kworker.0 00000100:00100000:3.0:1787834044.691728:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406189568 00000100:00100000:3.0:1787834044.691732:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406189568 00000100:00100000:3.0:1787834044.691970:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787834044.691978:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406189568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787834044.691997:0:17136:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787834044.692009:0:17136:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787834044.692088:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406188928:0@lo:400:kworker.0 20000000:01000000:3.0:1787834044.694159:0:17136:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787834044.694237:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787834044.694489:0:17157:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787834044.694494:0:17157:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787834044.694517:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.694534:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e5f5 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.694542:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e603 expref: 21 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.694550:0:17157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.694597:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e603 expref: 21 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.694611:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e603 expref: 21 pid: 17135 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834044.694623:0:17157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406189696:0@lo:104: 00000100:00100000:3.0:1787834044.694683:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787834044.694726:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e5f5 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.694734:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5f5 expref: 21 pid: 17133 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834044.694742:0:17157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504602d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406189824:0@lo:104: 00000100:00100000:3.0:1787834044.694786:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834044.694806:0:17157:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df603977780 going to sleep for 11 seconds 00000100:00100000:3.0:1787834044.694854:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:18643:x1874679406189568:12345-0@lo:253:mount.lustre.0 Request processed in 2876us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834044.694865:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787834044.695010:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787834044.695025:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406189696 00000100:00100000:1.0:1787834044.695031:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406189696 00000100:00100000:1.0:1787834044.695058:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406189824 00000100:00100000:1.0:1787834044.695061:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406189824 00000100:00100000:1.0:1787834044.695074:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834044.695081:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:17157:x1874679406189696:12345-0@lo:104: 00010000:00010000:1.0:1787834044.695094:0:17124:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695137:0:17124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787834044.695143:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:17157:x1874679406189696:12345-0@lo:104: Request processed in 63us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834044.695149:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834044.695162:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787834044.695175:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df633c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:17157:x1874679406189824:12345-0@lo:104: 00010000:00010000:1.0:1787834044.695183:0:17124:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695227:0:17124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787834044.695232:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df633c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:17157:x1874679406189824:12345-0@lo:104: Request processed in 59us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834044.695237:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787834044.695269:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787834044.695275:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695281:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787834044.695285:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695293:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787834044.695490:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834044.695498:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787834044.695526:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695533:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787834044.695551:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695568:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504676200/0x996d2fb20dc1e603 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e60a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695581:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834044.695585:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695591:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787834044.695594:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695601:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787834044.695607:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834044.695613:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787834044.695625:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695631:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787834044.695637:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695643:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504677400/0x996d2fb20dc1e5f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e5fc expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834044.695655:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834044.695661:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834044.695663:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834044.695697:0:17157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406189696:0@lo:104: 00000100:00100000:1.0:1787834044.695705:0:17157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504602d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406189824:0@lo:104: 00010000:00010000:1.0:1787834044.695724:0:17157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834044.696094:0:18643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:18643:1874679406189568:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787834044.696105:0:18643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787834044.696108:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787834044.696110:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787834044.696111:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834044.696112:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834044.696114:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834044.696115:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834044.696116:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787834044.696118:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834044.696125:0:18643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787834044.696137:0:18643:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787834044.696918:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834044.696956:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406190080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834044.697703:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.697774:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787834044.697783:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406189952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834044.697809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834044.697849:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406190080 00000100:00100000:2.0:1787834044.697856:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406190080 00010000:00010000:2.0:1787834044.697882:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5f5 expref: 21 pid: 17133 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834044.697905:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406189952 00000100:00100000:2.0:1787834044.697907:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406189952 00010000:00010000:2.0:1787834044.697918:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e603 expref: 22 pid: 17135 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834044.697931:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787834044.697939:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:3641:x1874679406190080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834044.697951:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834044.697957:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5f5 expref: 22 pid: 17133 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.697967:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e5f5 expref: 22 pid: 17133 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834044.697979:0:17127:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787834044.697983:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e5fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e5f5 expref: 22 pid: 17133 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834044.697987:0:17127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787834044.698006:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834044.698112:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:3641:x1874679406190080:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834044.698120:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787834044.698137:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787834044.698202:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635d76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:3641:x1874679406189952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834044.698212:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834044.698217:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e603 expref: 20 pid: 17135 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698227:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e603 expref: 20 pid: 17135 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698237:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504677e00/0x996d2fb20dc1e60a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e603 expref: 20 pid: 17135 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698247:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698254:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787834044.698267:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006417157s 00010000:00010000:2.0:1787834044.698272:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698279:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698296:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698302:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698308:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834044.698312:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698320:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.698427:0:17157:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834044.698436:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698467:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698476:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600030000/0x996d2fb20dc1e6b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834044.698489:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834044.698517:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635d76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:3641:x1874679406189952:12345-0@lo:103:ldlm_bl.0 Request processed in 373us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834044.698523:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787834044.698582:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406189952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834044.698592:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406190080:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787834044.699104:0:18643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787834044.703081:0:18643:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787834044.703089:0:18643:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787834044.703138:0:18643:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787834044.703173:0:18643:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787834044.703188:0:18643:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787834044.703284:0:18643:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787834044.706205:0:18643:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834044.706459:0:18643:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787834045.208421:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787834045.460373:0:18724:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787834045.460674:0:18724:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787834046.230079:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834046.294138:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406190208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787834046.294207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834046.294260:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406190208 00000100:00100000:1.0:1787834046.294268:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406190208 00000100:00100000:1.0:1787834046.294686:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787834046.294699:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406190208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787834046.294734:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787834046.294818:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406190208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834046.294826:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787834046.294873:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406190208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834046.297773:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787834046.297873:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406190336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834046.297949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834046.298000:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406190336 00000100:00100000:2.0:1787834046.298006:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406190336 00000100:00100000:2.0:1787834046.298055:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787834046.298064:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406190336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787834046.298097:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834046.298156:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406190336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834046.298163:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787834046.298301:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406190336:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1787834046.550860:0:17138:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787834046.550868:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df611643000 from 9 10000000:01000000:1.0:1787834046.550873:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787834046.550927:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834046.550947:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834046.550959:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834046.550983:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406190464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787834046.551053:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834046.551105:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834046.551169:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406190464 00000100:00100000:0.0:1787834046.551177:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406190464 00000100:00100000:0.0:1787834046.551233:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787834046.551241:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:17138:x1874679406190464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834046.551254:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834046.551265:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e6b9 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.551286:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e6b9 expref: 20 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.551297:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e6b9 expref: 20 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.551307:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677200, rc 0) 00000100:00100000:0.0:1787834046.551363:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:17138:x1874679406190464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834046.551370:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787834046.551413:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406190464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834046.551428:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.551436:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834046.551485:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406190592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787834046.551514:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834046.551534:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834046.551547:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406190592 00000100:00100000:0.0:1787834046.551550:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406190592 00000100:00100000:0.0:1787834046.551571:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787834046.551576:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:17138:x1874679406190592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787834046.551589:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787834046.551606:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787834046.551609:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787834046.551688:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:17138:x1874679406190592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834046.551695:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787834046.551726:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406190592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787834046.551808:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787834046.551814:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.551823:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834046.551831:0:17138:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787834046.551833:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df504d9f000 from 9 10000000:01000000:0.0:1787834046.551835:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787834046.551850:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.551857:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.551864:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834046.551882:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406190720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787834046.551908:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834046.551927:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834046.551937:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406190720 00000100:00100000:0.0:1787834046.551940:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406190720 00000100:00100000:0.0:1787834046.551959:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787834046.551965:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:17138:x1874679406190720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834046.551972:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834046.551979:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e6c7 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.551994:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e6c7 expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.552002:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e6c7 expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.552008:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676000, rc 0) 00000100:00100000:0.0:1787834046.552033:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:17138:x1874679406190720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834046.552039:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787834046.552068:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406190720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834046.552079:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.552086:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834046.552129:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406190848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787834046.552203:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834046.552217:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834046.552228:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406190848 00000100:00100000:0.0:1787834046.552231:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406190848 00000100:00100000:0.0:1787834046.552249:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787834046.552254:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:17138:x1874679406190848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787834046.552263:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787834046.552273:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787834046.552275:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787834046.552342:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:17138:x1874679406190848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 86us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834046.552349:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787834046.552378:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406190848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787834046.552416:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787834046.552421:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834046.552429:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834047.256187:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834048.277933:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834049.304222:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787834049.822111:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1787834049.878281:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834049.878297:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834049.878300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834049.878315:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834049.878346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834049.878350:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834049.878352:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834049.878355:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787834049.878398:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406191104:0@lo:400:kworker.0 00000100:00100000:0.0:1787834049.878472:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834049.878516:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406191616:0@lo:400:kworker.0 00000100:00100000:0.0:1787834049.878546:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834049.878572:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787834049.878578:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406190976:0@lo:400:kworker.0 00000100:00100000:0.0:1787834049.878616:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834049.878638:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406191488:0@lo:400:kworker.0 00000100:00100000:0.0:1787834049.878660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834049.878686:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406191232:0@lo:400:kworker.0 00000100:00100000:0.0:1787834049.878708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834049.878736:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406191744:0@lo:400:kworker.0 00000100:00100000:0.0:1787834049.878805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834049.878815:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406191616 00000100:00100000:1.0:1787834049.878824:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406191616 00000100:00100000:0.0:1787834049.878827:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787834049.878834:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406191360:0@lo:400:kworker.0 00000100:00100000:1.0:1787834049.878880:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406191488 00000100:00100000:1.0:1787834049.878884:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406191488 00000100:00100000:1.0:1787834049.878896:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406191232 00000100:00100000:1.0:1787834049.878898:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406191232 00000100:00100000:1.0:1787834049.878907:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406191744 00000100:00100000:1.0:1787834049.878909:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406191744 00000100:00100000:1.0:1787834049.878924:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787834049.878932:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406191616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834049.879122:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787834049.879131:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621338f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406191488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834049.881142:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406191616:12345-0@lo:400:kworker.0 Request processed in 2201us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834049.881156:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787834049.881191:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787834049.881203:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406191232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834049.881252:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406191232:12345-0@lo:400:kworker.0 Request processed in 53us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834049.881269:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787834049.881283:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787834049.882168:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787834049.882175:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787834049.882527:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406191744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834049.882598:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406191744:12345-0@lo:400:kworker.0 Request processed in 1308us (3793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834049.882608:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787834049.883440:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406191104 00000100:00100000:1.0:1787834049.883452:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406191104 00000100:00100000:1.0:1787834049.883500:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787834049.883508:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406191104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834049.883566:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406191104:12345-0@lo:400:kworker.0 Request processed in 59us (5095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834049.883574:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787834049.885247:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621338f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406191488:12345-0@lo:400:kworker.0 Request processed in 6110us (6578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834049.885260:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787834049.886013:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406190976 00000100:00100000:1.0:1787834049.886025:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406190976 00000100:00100000:1.0:1787834049.886076:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787834049.886085:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:3641:x1874679406190976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834049.886145:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:3641:x1874679406190976:12345-0@lo:400:kworker.0 Request processed in 62us (7528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834049.886152:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787834049.889548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834049.889610:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406191360 00000100:00100000:1.0:1787834049.889620:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406191360 00000100:00100000:0.0:1787834049.889645:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406190976:0@lo:400:kworker.0 00010000:00080000:0.0:1787834049.889667:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a98f00 x1874679406191488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834049.889684:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787834049.889690:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406191488:0@lo:400:kworker.0 00000100:00100000:1.0:1787834049.889697:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406191360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834049.889708:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406191104:0@lo:400:kworker.0 00010000:00080000:0.0:1787834049.889721:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6213392c0 x1874679406191616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834049.889730:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406191616:0@lo:400:kworker.0 00000100:00100000:1.0:1787834049.889798:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406191360:12345-0@lo:400:kworker.0 Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834049.889814:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787834049.890811:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406191360:0@lo:400:kworker.0 00010000:00080000:0.0:1787834049.890829:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a9a1c0 x1874679406191232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834049.890840:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406191232:0@lo:400:kworker.0 00010000:00080000:0.0:1787834049.891122:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df62133a940 x1874679406191744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834049.891131:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406191744:0@lo:400:kworker.0 00010000:00010000:1.0:1787834050.329254:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787834050.444554:0:19013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787834051.350628:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834051.417225:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406191872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787834051.417303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834051.417428:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406191872 00000100:00100000:1.0:1787834051.417436:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406191872 00000100:00100000:1.0:1787834051.417485:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787834051.417494:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406191872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787834051.417524:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787834051.417569:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406191872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834051.417576:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787834051.417641:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406191872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834051.418632:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787834051.418646:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406192000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834051.418689:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834051.420234:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406192000 00000100:00100000:1.0:1787834051.420245:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406192000 00000100:00100000:1.0:1787834051.420304:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787834051.420314:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406192000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787834051.420344:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787834051.420411:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406192000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834051.420417:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787834051.420588:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406192000:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1787834051.443349:0:19066:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787834051.443579:0:19066:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787834052.379058:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787834052.409785:0:19116:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787834052.409992:0:19116:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787834053.402860:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834053.591721:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787834054.421858:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787834054.997896:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834054.997912:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834054.997915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834054.997917:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834054.997936:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834054.997939:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834054.997942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834054.997945:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787834054.997986:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406192128:0@lo:400:kworker.0 00000100:00100000:0.0:1787834054.998053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834054.998107:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406192640:0@lo:400:kworker.0 00000100:00100000:0.0:1787834054.998135:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834054.999652:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787834054.999676:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406192512:0@lo:400:kworker.0 00000100:00100000:0.0:1787834054.999735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834054.999795:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406192256:0@lo:400:kworker.0 00000100:00100000:0.0:1787834054.999822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834054.999843:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406192768:0@lo:400:kworker.0 00000100:00100000:0.0:1787834054.999867:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834054.999888:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787834054.999895:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406192384:0@lo:400:kworker.0 00000100:00100000:0.0:1787834054.999917:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834054.999934:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406192896:0@lo:400:kworker.0 00000100:00100000:0.0:1787834054.999987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834055.000032:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406192128 00000100:00100000:0.0:1787834055.000040:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406192128 00000100:00100000:0.0:1787834055.000084:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787834055.000093:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:3641:x1874679406192128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000152:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:3641:x1874679406192128:12345-0@lo:400:kworker.0 Request processed in 60us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.000160:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787834055.000191:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406192640 00000100:00100000:0.0:1787834055.000195:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406192640 00000100:00100000:0.0:1787834055.000213:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406192768 00000100:00100000:0.0:1787834055.000216:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406192768 00000100:00100000:0.0:1787834055.000239:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406192384 00000100:00100000:0.0:1787834055.000241:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406192384 00000100:00100000:0.0:1787834055.000251:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406192896 00000100:00100000:0.0:1787834055.000263:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406192896 00000100:00100000:0.0:1787834055.000279:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834055.000285:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406192640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000314:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406192640:12345-0@lo:400:kworker.0 Request processed in 30us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.000319:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834055.000330:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787834055.000334:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406192768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000358:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406192768:12345-0@lo:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.000363:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787834055.000371:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787834055.000376:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406192384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000404:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406192384:12345-0@lo:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.000409:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787834055.000418:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787834055.000423:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406192896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000443:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406192896:12345-0@lo:400:kworker.0 Request processed in 21us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.000447:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787834055.000463:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406192512 00000100:00100000:0.0:1787834055.000466:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406192512 00000100:00100000:0.0:1787834055.000481:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406192256 00000100:00100000:0.0:1787834055.000484:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406192256 00000100:00100000:0.0:1787834055.000494:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787834055.000499:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406192512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000525:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406192512:12345-0@lo:400:kworker.0 Request processed in 26us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.000530:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787834055.000539:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787834055.000543:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406192256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000566:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406192256:12345-0@lo:400:kworker.0 Request processed in 22us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.000571:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787834055.000606:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df621338b40 x1874679406192384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834055.000620:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406192384:0@lo:400:kworker.0 00010000:00080000:0.0:1787834055.000641:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df62133a580 x1874679406192896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834055.000649:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406192896:0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000658:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406192256:0@lo:400:kworker.0 00010000:00080000:0.0:1787834055.000666:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df62133a940 x1874679406192768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834055.000674:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406192768:0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000702:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406192512:0@lo:400:kworker.0 00000100:00100000:0.0:1787834055.000709:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406192128:0@lo:400:kworker.0 00010000:00080000:0.0:1787834055.000717:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6213383c0 x1874679406192640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834055.000725:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406192640:0@lo:400:kworker.0 00000100:00080000:3.0:1787834055.000837:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787834055.001117:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787834055.458349:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834055.959628:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834040/real 1787834040] req@ffff8df6212fde00 x1874679406184320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834055 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834055.959654:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df6212fde00 x1874679406184320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834055 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834055.959670:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834040/real 1787834040] req@ffff8df6212fe940 x1874679406184448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834055 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834055.959682:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df6212fe940 x1874679406184448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834055 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787834055.959701:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df602ac8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834055.959715:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834055.959719:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406184320:0@lo:8:kworker.0 00000100:00080000:1.0:1787834055.959724:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834055.959729:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834055.959731:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406184448:0@lo:8:kworker.0 00000100:00080000:1.0:1787834055.959813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834055.959818:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834055.959821:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834055.959825:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834055.959845:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834055.959848:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787834055.959850:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df602ac8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787834055.959855:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 516 00000100:00080000:1.0:1787834055.959860:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787834055.959866:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df602ac8800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834055.959885:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50250ad00 x1874679406193536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834055.959909:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834055.959911:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787834055.959913:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787834055.959917:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 516 00000100:00080000:1.0:1787834055.959920:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787834055.959923:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df635806800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834055.959935:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50250a580 x1874679406193664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787834055.959973:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406193024:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.960033:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834055.960068:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406193792:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.960093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834055.960114:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787834055.960120:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406193152:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.960142:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834055.960159:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406193920:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.960182:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834055.960207:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406193280:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.960228:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834055.960244:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406194048:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.960278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834055.960295:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787834055.960301:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406193408:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.960332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834055.960365:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406193024 00000100:00100000:1.0:1787834055.960372:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406193024 00000100:00100000:1.0:1787834055.960415:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787834055.960423:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:3640:x1874679406193024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.960468:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:3640:x1874679406193024:12345-0@lo:400:kworker.0 Request processed in 46us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834055.960475:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787834055.960505:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406193792 00000100:00100000:1.0:1787834055.960508:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406193792 00000100:00100000:1.0:1787834055.962383:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406193920 00000100:00100000:1.0:1787834055.962394:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406193920 00000100:00100000:1.0:1787834055.962417:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406193280 00000100:00100000:1.0:1787834055.962420:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406193280 00000100:00100000:1.0:1787834055.962429:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406194048 00000100:00100000:1.0:1787834055.962431:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406194048 00000100:00100000:1.0:1787834055.962444:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787834055.962452:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406193792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.964346:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406193792:12345-0@lo:400:kworker.0 Request processed in 1889us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834055.964358:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787834055.964391:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787834055.964401:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406193920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.964452:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406193920:12345-0@lo:400:kworker.0 Request processed in 54us (4269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834055.964458:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787834055.964470:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787834055.964476:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406193280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.964536:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406193280:12345-0@lo:400:kworker.0 Request processed in 60us (4306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834055.964542:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787834055.964555:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787834055.964561:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406194048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.964587:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406194048:12345-0@lo:400:kworker.0 Request processed in 27us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834055.964593:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787834055.964612:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406193152 00000100:00100000:1.0:1787834055.964618:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406193152 00000100:00100000:1.0:1787834055.964642:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406193408 00000100:00100000:1.0:1787834055.964644:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406193408 00000100:00100000:1.0:1787834055.964655:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787834055.964661:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406193152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.964690:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406193152:12345-0@lo:400:kworker.0 Request processed in 29us (4548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834055.964695:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787834055.964705:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787834055.964710:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406193408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.964735:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406193408:12345-0@lo:400:kworker.0 Request processed in 25us (4402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834055.964740:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787834055.964823:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406193408:0@lo:400:kworker.0 00010000:00080000:1.0:1787834055.964839:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502509680 x1874679406193280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834055.964861:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406193280:0@lo:400:kworker.0 00010000:00080000:1.0:1787834055.964874:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff2580 x1874679406194048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834055.964882:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406194048:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.964921:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406193152:0@lo:400:kworker.0 00010000:00080000:1.0:1787834055.964933:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff0b40 x1874679406193920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834055.964942:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406193920:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.964952:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406193024:0@lo:400:kworker.0 00010000:00080000:1.0:1787834055.964962:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff3840 x1874679406193792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834055.964970:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406193792:0@lo:400:kworker.0 00000100:00100000:1.0:1787834055.964995:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406193536:0@lo:8:kworker.0 00000100:00100000:1.0:1787834055.965029:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834055.965060:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406193664:0@lo:8:kworker.0 00000100:00100000:1.0:1787834055.965080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834055.965188:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406193536 00000100:00100000:3.0:1787834055.965193:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406193536 00000100:00100000:3.0:1787834055.965222:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406193664 00000100:00100000:3.0:1787834055.965225:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406193664 00000100:00100000:3.0:1787834055.965235:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834055.965240:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406193536:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787834055.965275:0:18649:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:3.0:1787834055.965302:0:18649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1e6d5 00002000:00100000:3.0:1787834055.965315:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8df6065e5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787834055.965320:0:18649:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787834055.965322:0:18649:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787834055.965469:0:18649:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787834055.965493:0:18649:0:(import.c:65:import_set_state_nolock()) ffff8df6065e1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834055.965531:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874679406193536:12345-0@lo:8:kworker.0 Request processed in 290us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834055.965539:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834055.965553:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834055.965556:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406193664:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787834055.965567:0:18649:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1787834055.967086:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250ad00 x1874679406193536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787834075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834055.967100:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787834055.967108:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787834055.967116:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787834055.967127:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787834055.967131:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df602ac8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787834055.967145:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787834055.967151:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406193536:0@lo:8:kworker.0 00000004:00080000:1.0:1787834055.967176:0:17882:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787834055.967260:0:17882:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 531880509215ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787834055.967267:0:17882:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1787834055.968872:0:17883:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787834055.968898:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17883:1874679406194304:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787834055.968960:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834055.969193:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5010840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834055.969211:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406194176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787834055.969238:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787834055.970205:0:17874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787834055.971219:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406194176 00000100:00100000:0.0:1787834055.971231:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406194176 00000100:00100000:0.0:1787834055.971301:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787834055.971311:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874679406194176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787834055.971342:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787834055.971409:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874679406194176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.971416:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787834055.971435:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787834055.972450:0:18648:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787834055.972460:0:18648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:1.0:1787834055.973448:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff2580 x1874679406194176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834055.973473:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406194176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787834055.978329:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406194304 00000100:00100000:2.0:1787834055.978342:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406194304 00000100:00100000:2.0:1787834055.978462:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787834055.978478:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17883:x1874679406194304:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1787834055.987239:0:19277:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787834055.987258:0:19277:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787834055.987359:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17883:x1874679406194304:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8879us (18394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.987373:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787834055.987630:0:17883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff1680 x1874679406194304/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787834071 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834055.987646:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17883:1874679406194304:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787834055.987661:0:17883:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787834055.987701:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17883:1874679406194432:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787834055.987739:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834055.988638:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834055.994277:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406193664:12345-0@lo:8:kworker.0 Request processed in 28712us (29189us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787834055.994290:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787834055.994377:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406194432 00000100:00080000:2.0:1787834055.994382:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787834055.994384:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406194432 00000100:00080000:2.0:1787834055.994388:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787834055.994392:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406193664:0@lo:8:kworker.0 00000100:00100000:0.0:1787834055.994436:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787834055.994444:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17883:x1874679406194432:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787834055.994473:0:18648:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787834055.994521:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17883:x1874679406194432:12345-0@lo:5:osp-pre-0-1.0 Request processed in 79us (6783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834055.994528:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787834055.994616:0:17883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6212fda40 x1874679406194432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787834071 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834055.994628:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17883:1874679406194432:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787834055.994639:0:17883:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787834055.994678:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17883:1874679406194560:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787834055.994711:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834055.994737:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834055.994790:0:19277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406194560 00000100:00100000:0.0:1787834055.994794:0:19277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406194560 00000100:00100000:0.0:1787834055.994890:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834055.994899:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17883:x1874679406194560:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787834055.994924:0:19277:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1787834056.020093:0:18644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787834056.020111:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787834056.020357:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17883:x1874679406194560:12345-0@lo:5:osp-pre-0-1.0 Request processed in 25454us (25639us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787834056.020368:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787834056.020934:0:17883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6212fda40 x1874679406194560/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787834071 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834056.020947:0:17883:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787834056.020959:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17883:1874679406194560:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787834056.021046:0:17883:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1787834056.021093:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17883:1874679406194688:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787834056.021135:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834056.023324:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834056.023541:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406194688 00000100:00100000:0.0:1787834056.023549:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406194688 00000100:00100000:0.0:1787834056.023601:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787834056.023611:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17883:x1874679406194688:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787834056.023731:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17883:x1874679406194688:12345-0@lo:900:osp-pre-0-1.0 Request processed in 121us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834056.023739:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787834056.026677:0:17883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df6212fda40 x1874679406194688/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787834072 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834056.026696:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17883:1874679406194688:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1787834056.470945:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834056.536218:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787834056.536252:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406194816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834056.536322:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834056.536508:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406194816 00000100:00100000:2.0:1787834056.536515:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406194816 00000100:00100000:2.0:1787834056.536575:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787834056.536584:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621338780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406194816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787834056.536616:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834056.536873:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621338780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406194816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 225us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834056.536881:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787834056.536970:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406194816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787834056.539193:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787834056.539218:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406194944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834056.539300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834056.539702:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406194944 00000100:00100000:0.0:1787834056.539711:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406194944 00000100:00100000:0.0:1787834056.539786:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787834056.539796:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504602d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406194944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787834056.540026:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787834056.540191:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504602d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406194944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 397us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834056.540199:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787834056.540404:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406194944:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787834057.494894:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834058.518142:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787834059.037102:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1787834059.174398:0:19462:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787834059.174402:0:19462:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787834059.174404:0:19462:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787834059.174740:0:19462:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df63a82c000 00000020:01000004:1.0:1787834059.174957:0:19462:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787834059.174972:0:19462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787834059.174985:0:19462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df603468000) 00000020:00000080:1.0:1787834059.175001:0:19462:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787834059.242135:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787834059.244101:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787834059.244366:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787834059.244886:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787834059.245090:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787834059.245309:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787834059.245541:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1787834059.248166:0:19462:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787834059.248852:0:19462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787834059.248866:0:19462:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787834059.248879:0:19462:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x996d2fb20dc1e6e3 00000020:01000004:2.0:1787834059.248885:0:19462:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787834059.248905:0:19462:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787834059.248908:0:19462:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787834059.248914:0:19462:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787834059.248941:0:19462:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787834059.248944:0:19462:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787834059.272215:0:19462:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787834059.272265:0:19462:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.117@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787834059.272269:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787834059.272271:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834059.272272:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834059.272273:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834059.272274:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834059.272276:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834059.272277:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834059.272279:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834059.272280:0:19462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787834059.272283:0:19462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787834059.272285:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787834059.272286:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834059.272288:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834059.272289:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834059.272290:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834059.272291:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834059.272292:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834059.272293:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834059.272294:0:19462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787834059.272641:0:19462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787834059.272661:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195072:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787834059.272729:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834059.273185:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787834059.274001:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406195072 00000100:00100000:2.0:1787834059.274010:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406195072 00000100:00100000:2.0:1787834059.274125:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787834059.274243:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:19462:x1874679406195072:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787834059.274276:0:17136:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787834059.274279:0:17136:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787834059.274283:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787834059.275028:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:19462:x1874679406195072:12345-0@lo:253:mount.lustre.0 Request processed in 889us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.275037:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787834059.275300:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195072:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787834059.275442:0:19462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787834059.275445:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787834059.275447:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834059.275459:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834059.275460:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834059.275462:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834059.275463:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834059.275465:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834059.275466:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834059.275468:0:19462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787834059.275486:0:19462:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df63a82c000 from lustre-OST0001 10000000:01000000:3.0:1787834059.275513:0:19462:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787834059.275517:0:19462:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787834059.275842:0:19462:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df503f10000 local copy 00010000:00010000:3.0:1787834059.275854:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834059.275947:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834059.275986:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834059.276089:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787834059.276243:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406195200 00000100:00100000:1.0:1787834059.276249:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406195200 00000100:00100000:1.0:1787834059.276298:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787834059.276435:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:19462:x1874679406195200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834059.276625:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:19462:x1874679406195200:12345-0@lo:501:mount.lustre.0 Request processed in 318us (637us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787834059.276633:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787834059.276713:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195200:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787834059.276830:0:19462:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787834059.276851:0:19462:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787834059.276859:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.276869:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834059.276895:0:19462:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df63a82c000 10000000:01000000:1.0:1787834059.276899:0:19462:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787834059.276905:0:19462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787834059.276907:0:19462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787834059.276911:0:19462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787834059.276914:0:19462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787834059.276936:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.276943:0:19462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.276952:0:19462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834059.276964:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834059.276999:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.277067:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a845840 going to sleep for 11 seconds 00000100:00100000:2.0:1787834059.283293:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406195328 00000100:00100000:2.0:1787834059.283440:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406195328 00000100:00100000:2.0:1787834059.283549:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787834059.283571:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:19462:x1874679406195328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834059.283591:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834059.283612:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504ccd600/0x996d2fb20dc1e6f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e6ea expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.283644:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504ccd600/0x996d2fb20dc1e6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e6ea expref: 22 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.283677:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504ccd600/0x996d2fb20dc1e6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e6ea expref: 22 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.283686:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccd600, rc 0) 00000100:00100000:2.0:1787834059.283901:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195328:12345-0@lo:101:mount.lustre.0 Request processed in 333us (6900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.283908:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787834059.286458:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834059.286490:0:19462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.286503:0:19462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787834059.293058:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787834059.295036:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834059.300789:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787834059.300844:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787834059.300859:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787834059.300871:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787834059.300883:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787834059.300895:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787834059.300922:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787834059.300928:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787834059.301034:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834059.302452:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.302561:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a845480 going to sleep for 11 seconds 00000100:00100000:0.0:1787834059.304041:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406195456 00000100:00100000:0.0:1787834059.304055:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406195456 00000100:00100000:0.0:1787834059.304187:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787834059.304198:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834059.304410:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195456:12345-0@lo:501:mount.lustre.0 Request processed in 214us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834059.304418:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787834059.304508:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834059.304893:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834059.305015:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834059.305182:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604dc0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787834059.305385:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406195584 00000100:00100000:1.0:1787834059.305392:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406195584 00000100:00100000:1.0:1787834059.305427:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787834059.305435:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195584:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834059.306503:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195584:12345-0@lo:503:mount.lustre.0 Request processed in 1064us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.306523:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787834059.306698:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195584:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787834059.309651:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787834059.309791:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834059.309871:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834059.309962:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604dc0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787834059.310683:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406195712 00000100:00100000:0.0:1787834059.310693:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406195712 00000100:00100000:1.0:1787834059.315263:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787834059.315290:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834059.316615:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195712:12345-0@lo:502:mount.lustre.0 Request processed in 1331us (6736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.316626:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787834059.320238:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787834059.320506:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787834059.320535:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787834059.320549:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787834059.320560:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787834059.320571:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787834059.320583:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787834059.320595:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787834059.320607:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787834059.320633:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787834059.320679:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834059.320748:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834059.320819:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604dc0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787834059.321074:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406195840 00000100:00100000:0.0:1787834059.321081:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406195840 00000100:00100000:0.0:1787834059.321136:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787834059.321144:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834059.321266:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195840:12345-0@lo:502:mount.lustre.0 Request processed in 122us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834059.321274:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787834059.321617:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787834059.321674:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787834059.321684:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1787834059.323559:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787834059.323570:0:19466:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787834059.323577:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834059.323580:0:19466:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787834059.323585:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787834059.323601:0:19466:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df62ea91a48) 00000020:00000080:2.0:1787834059.323626:0:19466:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787834059.323633:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787834059.323727:0:19466:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df63a82c000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787834059.323737:0:19466:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787834059.323744:0:19466:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x996d2fb20dc1e6ff 00010000:00010000:3.0:1787834059.333147:0:19466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1787834059.333644:0:19466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1787834059.336192:0:19466:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1787834059.343055:0:19466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787834059.343068:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834059.343086:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834059.343089:0:19466:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787834059.343093:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834059.343096:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834059.343098:0:19466:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787834059.343100:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787834059.343102:0:19466:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787834059.343105:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834059.343107:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834059.343114:0:19466:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787834059.343117:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834059.343120:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834059.343121:0:19466:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787834059.343125:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787834059.343157:0:19466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834059.343160:0:19466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834059.343162:0:19466:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787834059.343165:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787834059.347974:0:19462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787834059.348021:0:19462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787834059.348040:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.348052:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834059.348061:0:19462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63a82c000 from 1 10000000:01000000:2.0:1787834059.348064:0:19462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787834059.348113:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.348133:0:19462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.348145:0:19462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834059.348170:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834059.348246:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834059.348284:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604dc0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787834059.350950:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406195968 00000100:00100000:1.0:1787834059.350965:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406195968 00000100:00100000:1.0:1787834059.351065:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787834059.351085:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:19462:x1874679406195968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834059.351101:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834059.351118:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e706 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.351145:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e706 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.351156:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e706 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.351165:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722400, rc 0) 00000100:00100000:1.0:1787834059.351244:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406195968:12345-0@lo:101:mount.lustre.0 Request processed in 161us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.351251:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787834059.351367:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406195968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834059.351387:0:19462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.351397:0:19462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787834059.356653:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787834059.356952:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787834059.357434:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787834059.357460:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787834059.357476:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787834059.357481:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787834059.357629:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834059.357698:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834059.357744:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787834059.358676:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406196096 00000100:00100000:2.0:1787834059.358687:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406196096 00000100:00100000:2.0:1787834059.358770:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787834059.358782:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406196096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834059.358915:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406196096:12345-0@lo:501:mount.lustre.0 Request processed in 136us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.358923:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787834059.359059:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834059.362548:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834059.362638:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834059.362688:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787834059.362770:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406196224 00000100:00100000:2.0:1787834059.362778:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406196224 00000100:00100000:2.0:1787834059.362836:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787834059.362846:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406196224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834059.362969:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406196224:12345-0@lo:503:mount.lustre.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.362977:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787834059.363302:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196224:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787834059.363721:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787834059.364149:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834059.364202:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834059.364244:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787834059.364308:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406196352 00000100:00100000:2.0:1787834059.364313:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406196352 00000100:00100000:2.0:1787834059.364355:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787834059.364363:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406196352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834059.364471:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406196352:12345-0@lo:502:mount.lustre.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.364478:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787834059.364655:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787834059.364959:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787834059.364984:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787834059.364996:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787834059.365007:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787834059.365018:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787834059.365028:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787834059.365039:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787834059.365051:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1787834059.365062:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787834059.365444:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1787834059.365470:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1787834059.365564:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196480:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834059.365614:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834059.365683:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787834059.366182:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406196480 00000100:00100000:1.0:1787834059.366189:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406196480 00000100:00100000:1.0:1787834059.366240:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787834059.366254:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406196480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834059.366359:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406196480:12345-0@lo:502:mount.lustre.0 Request processed in 105us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.366366:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787834059.367012:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196480:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787834059.367091:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1787834059.367102:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787834059.369672:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834059.369685:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834059.369687:0:19470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787834059.369694:0:19470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df63a82c000 00000020:00000080:1.0:1787834059.369697:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787834059.369705:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834059.369707:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834059.369709:0:19470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787834059.369711:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834059.369714:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834059.369715:0:19470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787834059.369718:0:19470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df63a82c000 00000020:00000080:1.0:1787834059.369720:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787834059.369816:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834059.369821:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834059.369823:0:19470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787834059.369826:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834059.369828:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834059.369829:0:19470:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787834059.369833:0:19470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df63a82c000 00000020:00000080:1.0:1787834059.369835:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787834059.369854:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834059.369858:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834059.369859:0:19470:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787834059.369862:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834059.369864:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834059.369865:0:19470:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787834059.369869:0:19470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df63a82c000 00000020:00000080:1.0:1787834059.369884:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787834059.369912:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834059.369915:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834059.369917:0:19470:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787834059.369920:0:19470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787834059.371359:0:19462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787834059.372182:0:19462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787834059.372214:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834059.372235:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834059.372293:0:19462:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787834059.372296:0:19462:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df63a82c000 10000000:01000000:0.0:1787834059.372300:0:19462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df63a82c000 10000000:01000000:0.0:1787834059.372438:0:19462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787834059.372445:0:19462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df63a82c000 from 1 10000000:01000000:0.0:1787834059.372448:0:19462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787834059.372484:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834059.372492:0:19462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834059.372503:0:19462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834059.372536:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787834059.372601:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834059.379493:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50000 going to sleep for 11 seconds 00000100:00100000:1.0:1787834059.384336:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406196608 00000100:00100000:1.0:1787834059.384350:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406196608 00000100:00100000:1.0:1787834059.384430:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787834059.384442:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:19462:x1874679406196608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834059.384460:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834059.384479:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e71b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e714 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.384520:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e714 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.384532:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e714 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.384541:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722000, rc 0) 00000100:00100000:1.0:1787834059.384622:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406196608:12345-0@lo:101:mount.lustre.0 Request processed in 182us (12020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.384629:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787834059.385502:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834059.385579:0:19462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834059.385591:0:19462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787834059.390335:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1787834059.390630:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834059.390968:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787834059.390993:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787834059.391007:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787834059.391020:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787834059.391032:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787834059.391054:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787834059.391065:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787834059.391146:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787834059.391172:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787834059.391185:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787834059.391198:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787834059.391212:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787834059.391238:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787834059.391253:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787834059.391266:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787834059.391295:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787834059.391312:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787834059.391326:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787834059.391339:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787834059.391350:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787834059.391361:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787834059.392168:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787834059.392199:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787834059.392212:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787834059.392234:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787834059.392249:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787834059.392260:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787834059.392271:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787834059.392281:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787834059.392291:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787834059.392303:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787834059.392331:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787834059.392347:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787834059.392359:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787834059.393176:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787834059.393243:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787834059.393261:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787834059.393277:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787834059.393303:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1787834059.393317:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1787834059.393329:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1787834059.393341:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1787834059.393353:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1787834059.393367:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1787834059.393522:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1787834059.393539:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1787834059.393567:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1787834059.393574:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1787834059.393686:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834059.393770:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.393818:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a8450c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834059.395042:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406196736 00000100:00100000:3.0:1787834059.395053:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406196736 00000100:00100000:3.0:1787834059.395177:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787834059.395187:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406196736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834059.395348:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406196736:12345-0@lo:501:mount.lustre.0 Request processed in 162us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834059.395356:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787834059.395872:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834059.395916:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834059.395962:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.395998:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a8450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834059.396146:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406196864 00000100:00100000:2.0:1787834059.396152:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406196864 00000100:00100000:2.0:1787834059.396191:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787834059.396199:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406196864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834059.396295:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406196864:12345-0@lo:503:mount.lustre.0 Request processed in 96us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.396303:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787834059.397194:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787834059.397685:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787834059.398948:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834059.399023:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.399065:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a8450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834059.399819:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406196992 00000100:00100000:2.0:1787834059.399829:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406196992 00000100:00100000:2.0:1787834059.399878:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787834059.399887:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406196992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834059.400011:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406196992:12345-0@lo:502:mount.lustre.0 Request processed in 124us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.400019:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787834059.400497:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406196992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834059.400704:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787834059.400734:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787834059.400773:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787834059.400791:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787834059.401536:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787834059.401554:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787834059.401570:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787834059.401582:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787834059.401594:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787834059.401607:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787834059.401621:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787834059.401636:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787834059.401649:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787834059.401680:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787834059.401695:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787834059.401709:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787834059.401720:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787834059.401734:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787834059.401745:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787834059.403187:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787834059.403211:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787834059.403237:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787834059.403253:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787834059.403269:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787834059.403282:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787834059.403295:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787834059.403309:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787834059.403322:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787834059.403335:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787834059.403364:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787834059.403391:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787834059.403404:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787834059.403416:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787834059.403428:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787834059.403442:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787834059.403456:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787834059.403470:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787834059.403496:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787834059.403511:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787834059.403525:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787834059.403537:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787834059.403551:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787834059.403566:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787834059.403580:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787834059.403594:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787834059.403624:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787834059.403641:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787834059.403655:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787834059.403708:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406197120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834059.403804:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.403847:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a845240 going to sleep for 11 seconds 00000100:00100000:0.0:1787834059.404062:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406197120 00000100:00100000:0.0:1787834059.404079:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406197120 00000100:00100000:0.0:1787834059.408233:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787834059.408255:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406197120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834059.412368:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406197120:12345-0@lo:502:mount.lustre.0 Request processed in 4113us (8555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834059.412382:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787834059.420507:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406197120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834059.420818:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787834059.420846:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787834059.420883:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406197248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834059.420955:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.420995:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a845240 going to sleep for 11 seconds 00000100:00100000:0.0:1787834059.421129:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406197248 00000100:00100000:0.0:1787834059.421135:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406197248 00000100:00100000:0.0:1787834059.421185:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787834059.421194:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406197248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834059.422183:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406197248:12345-0@lo:502:mount.lustre.0 Request processed in 987us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834059.422193:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787834059.424987:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406197248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834059.425827:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1787834059.425845:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787834059.426919:0:19476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787834059.426933:0:19476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df60346ced8) 00000020:00000080:1.0:1787834059.426956:0:19476:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787834059.427051:0:19476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df63a82c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787834059.427056:0:19476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63a82c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787834059.427058:0:19476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63a82c000 3 00010000:00080000:1.0:1787834059.427158:0:19476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df502ccb800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834059.429029:0:19476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787834059.431342:0:19476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787834059.431390:0:19476:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787834059.431405:0:19476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x996d2fb20dc1e729 00000100:00080000:1.0:1787834059.431415:0:19476:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834059.431422:0:19476:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df502ccb800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834059.431456:0:19476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502ff1a40 x1874679406197376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787834059.431500:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406197376:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787834059.431572:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.431627:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406197376 00000100:00100000:1.0:1787834059.431632:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406197376 00000100:00100000:1.0:1787834059.431659:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834059.431665:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874679406197376:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787834059.431686:0:18167:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:1.0:1787834059.431714:0:18167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x996d2fb20dc1e730 00000004:00100000:1.0:1787834059.431727:0:18167:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787834059.431775:0:18167:0:(import.c:65:import_set_state_nolock()) ffff8df502cce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834059.431824:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874679406197376:12345-0@lo:38:llog_process_th.0 Request processed in 157us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.431832:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787834059.431870:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff1a40 x1874679406197376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834059.431880:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787834059.431887:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787834059.431899:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787834059.431903:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787834059.431906:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502ccb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787834059.431912:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406197376:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787834059.431931:0:19476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787834059.431970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834059.431974:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834059.431977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834059.431980:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834059.432011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834059.432014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787834059.432016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787834059.432020:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 531 00000100:00080000:1.0:1787834059.432023:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787834059.432027:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df635806800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834059.432041:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502ff2580 x1874679406198016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787834059.432855:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406197632:0@lo:400:kworker.0 00000100:00100000:3.0:1787834059.432902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834059.432928:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406198272:0@lo:400:kworker.0 00000100:00100000:3.0:1787834059.432956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834059.432976:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787834059.432982:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406197504:0@lo:400:kworker.0 00000100:00100000:3.0:1787834059.433008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834059.433032:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406198144:0@lo:400:kworker.0 00000100:00100000:3.0:1787834059.433054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834059.433490:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406197504 00000100:00100000:2.0:1787834059.433498:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406197504 00000100:00100000:2.0:1787834059.433586:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787834059.433594:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406197504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834059.433654:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406197504:12345-0@lo:400:kworker.0 Request processed in 61us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.433661:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787834059.433745:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406197760:0@lo:400:kworker.0 00000100:00100000:1.0:1787834059.433791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.434548:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406198400:0@lo:400:kworker.0 00000100:00100000:1.0:1787834059.434580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.434614:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787834059.434620:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406197888:0@lo:400:kworker.0 00000100:00100000:1.0:1787834059.434658:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.434692:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406197632 00000100:00100000:1.0:1787834059.434698:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406197632 00000100:00100000:1.0:1787834059.434723:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406198272 00000100:00100000:1.0:1787834059.434727:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406198272 00000100:00100000:1.0:1787834059.434771:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406198144 00000100:00100000:1.0:1787834059.434774:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406198144 00000100:00100000:1.0:1787834059.434787:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406198400 00000100:00100000:1.0:1787834059.434790:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406198400 00000100:00100000:1.0:1787834059.434834:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787834059.434841:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406197632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834059.434882:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406197632:12345-0@lo:400:kworker.0 Request processed in 41us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.434888:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787834059.434901:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787834059.434907:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504603840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406198272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834059.434935:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504603840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406198272:12345-0@lo:400:kworker.0 Request processed in 28us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.434941:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787834059.434953:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787834059.434960:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406198144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834059.434987:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406198144:12345-0@lo:400:kworker.0 Request processed in 28us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.434993:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787834059.435003:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787834059.435009:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406198400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834059.435041:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406198400:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.435053:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787834059.435233:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406197888 00000100:00100000:1.0:1787834059.435237:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406197888 00000100:00100000:1.0:1787834059.435272:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787834059.435279:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406197888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834059.435310:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406197888:12345-0@lo:400:kworker.0 Request processed in 32us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.435316:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787834059.435332:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787834059.435336:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787834059.435338:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787834059.435361:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff03c0 x1874679406197888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787834075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834059.435375:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406197888:0@lo:400:kworker.0 00010000:00080000:1.0:1787834059.435386:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250a580 x1874679406198400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834059.435394:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406198400:0@lo:400:kworker.0 00000100:00100000:1.0:1787834059.435427:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406198016:0@lo:8:kworker.0 00000100:00100000:1.0:1787834059.435464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.435495:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406198016 00000100:00100000:1.0:1787834059.435498:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406198016 00000100:00100000:1.0:1787834059.435519:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834059.435524:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1874679406198016:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787834059.435570:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1874679406198016:12345-0@lo:8:kworker.0 Request processed in 44us (105us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787834059.435584:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834059.435608:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787834059.435613:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834059.435617:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787834059.435620:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406198016:0@lo:8:kworker.0 00000100:00100000:3.0:1787834059.435785:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406197760 00000100:00100000:3.0:1787834059.435790:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406197760 00000100:00100000:0.0:1787834059.435902:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406197504:0@lo:400:kworker.0 00010000:00080000:0.0:1787834059.435925:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff1680 x1874679406198144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834059.435934:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406198144:0@lo:400:kworker.0 00010000:00080000:0.0:1787834059.435945:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502ff2d00 x1874679406197632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834059.435953:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406197632:0@lo:400:kworker.0 00010000:00080000:0.0:1787834059.435964:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502508000 x1874679406198272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834059.435972:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406198272:0@lo:400:kworker.0 00000020:01000004:1.0:1787834059.436295:0:19476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787834059.436310:0:19476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8df603469a48) 00000020:00000080:1.0:1787834059.436329:0:19476:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787834059.436402:0:19476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df63a82c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787834059.436406:0:19476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63a82c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787834059.436408:0:19476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63a82c000 3 00010000:00080000:1.0:1787834059.436434:0:19476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df502ccb000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.117@tcp at head 00000100:00100000:3.0:1787834059.437794:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787834059.437813:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406197760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834059.437909:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406197760:12345-0@lo:400:kworker.0 Request processed in 100us (4118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834059.437916:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787834059.438920:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406197760:0@lo:400:kworker.0 00010000:00010000:1.0:1787834059.440569:0:19476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1787834059.441369:0:19476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787834059.441412:0:19476:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787834059.441425:0:19476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x996d2fb20dc1e73e 00000100:00080000:1.0:1787834059.441434:0:19476:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834059.441440:0:19476:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8df502ccb000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834059.441472:0:19476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502509680 x1874679406198528/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787834059.441512:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406198528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787834059.441575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.441632:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406198528 00000100:00100000:1.0:1787834059.441639:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406198528 00000100:00100000:1.0:1787834059.441670:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787834059.441677:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406198528:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787834059.441710:0:17141:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:1.0:1787834059.441737:0:17141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x996d2fb20dc1e745 00000004:00100000:1.0:1787834059.441772:0:17141:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787834059.442903:0:17141:0:(import.c:65:import_set_state_nolock()) ffff8df502cc8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834059.442986:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874679406198528:12345-0@lo:38:llog_process_th.0 Request processed in 1306us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.442996:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787834059.443053:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502509680 x1874679406198528/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834059.443064:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787834059.445001:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787834059.445016:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787834059.445022:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787834059.445025:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502ccb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787834059.445034:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406198528:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787834059.445064:0:19476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787834059.445103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834059.445108:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834059.445111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834059.445114:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787834059.458710:0:19476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1787834059.461019:0:19462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787834059.461067:0:19462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787834059.461093:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834059.461106:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787834059.461163:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787834059.461165:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834059.461167:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834059.461168:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834059.461169:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834059.461171:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834059.461172:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834059.461174:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834059.461175:0:19462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787834059.461178:0:19462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787834059.461181:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787834059.461182:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834059.461183:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834059.461184:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834059.461185:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834059.461186:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834059.461187:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834059.461189:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834059.461190:0:19462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787834059.461219:0:19462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787834059.461250:0:19462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406198656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787834059.461318:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834059.461358:0:19462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604dc0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787834059.461390:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406198656 00000100:00100000:3.0:1787834059.461396:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406198656 00000100:00100000:3.0:1787834059.461439:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787834059.461447:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406198656:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787834059.461473:0:17133:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787834059.461486:0:17133:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787834059.479026:0:17133:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787834059.479049:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787834059.479170:0:17157:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787834059.479176:0:17157:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787834059.479197:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.479244:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e6b9 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.479251:0:17157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e6c7 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.479259:0:17157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.479298:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e6c7 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.479313:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e6c7 expref: 24 pid: 17136 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834059.479327:0:17157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406198784:0@lo:104: 00000100:00100000:1.0:1787834059.479391:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834059.479457:0:17157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e6b9 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.479465:0:17157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e6b9 expref: 24 pid: 17135 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834059.479468:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406198784 00000100:00100000:1.0:1787834059.479473:0:17157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406198912:0@lo:104: 00000100:00100000:2.0:1787834059.479475:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406198784 00000100:00100000:1.0:1787834059.479496:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834059.479519:0:17157:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a845240 going to sleep for 11 seconds 00000100:00100000:2.0:1787834059.480766:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406198912 00000100:00100000:2.0:1787834059.480776:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406198912 00000100:00100000:2.0:1787834059.480935:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834059.480944:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:17157:x1874679406198784:12345-0@lo:104: 00010000:00010000:2.0:1787834059.480962:0:17125:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834059.481011:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:19462:x1874679406198656:12345-0@lo:253:mount.lustre.0 Request processed in 19563us (19692us total) trans 0 rc 0/0 00010000:00010000:2.0:1787834059.481013:0:17125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787834059.481018:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:17157:x1874679406198784:12345-0@lo:104: Request processed in 76us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834059.481021:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787834059.481023:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834059.481164:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834059.481172:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:17157:x1874679406198912:12345-0@lo:104: 00010000:00010000:2.0:1787834059.481180:0:17125:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.481230:0:17125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787834059.481235:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:17157:x1874679406198912:12345-0@lo:104: Request processed in 65us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.481241:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787834059.481249:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834059.481256:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834059.481256:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.481264:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677e00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787834059.481268:0:17129:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.481275:0:17129:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787834059.481282:0:17129:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834059.481301:0:17129:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787834059.481334:0:17129:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.481340:0:17129:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787834059.481360:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.481367:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504677e00/0x996d2fb20dc1e6c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e6ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834059.481379:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834059.481381:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834059.481383:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834059.481403:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406199040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834059.481435:0:17157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406198784:0@lo:104: 00000100:00100000:1.0:1787834059.484017:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834059.484900:0:17157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17157:1874679406198912:0@lo:104: 00010000:00010000:2.0:1787834059.484934:0:17157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834059.485407:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406199040 00000100:00100000:0.0:1787834059.485416:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406199040 00010000:00010000:0.0:1787834059.485454:0:18674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e6c7 expref: 24 pid: 17136 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834059.485492:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787834059.485502:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3641:x1874679406199040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834059.485517:0:18674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834059.485523:0:18674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e6c7 expref: 24 pid: 17136 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834059.485534:0:18674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e6c7 expref: 24 pid: 17136 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834059.485564:0:18674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e6ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e6c7 expref: 24 pid: 17136 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834059.485580:0:18674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834059.485636:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:3641:x1874679406199040:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834059.485643:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787834059.486000:0:19462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:19462:1874679406198656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787834059.486014:0:19462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787834059.486018:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787834059.486019:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834059.486020:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834059.486021:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834059.486022:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834059.486024:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834059.486026:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834059.486028:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834059.486029:0:19462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787834059.486039:0:19462:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787834059.490658:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406199040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834059.499513:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834059.499521:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834059.499524:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834059.502396:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.502416:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834059.502421:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.502432:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834059.502440:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834059.502446:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787834059.502552:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.502559:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787834059.502583:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.502589:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df620723600/0x996d2fb20dc1e6b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e6c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.502609:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834059.502624:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834059.502626:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834059.502637:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787834059.502658:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406199168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834059.502723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834059.507400:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406199168 00000100:00100000:2.0:1787834059.507412:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406199168 00010000:00010000:2.0:1787834059.507453:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e6b9 expref: 23 pid: 17135 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834059.507500:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834059.507512:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:3639:x1874679406199168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834059.507527:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834059.507533:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e6b9 expref: 23 pid: 17135 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507547:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e6b9 expref: 23 pid: 17135 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507567:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504677200/0x996d2fb20dc1e6c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e6b9 expref: 23 pid: 17135 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507586:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507594:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787834059.507613:0:17126:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.028437857s 00010000:00010000:2.0:1787834059.507618:0:17126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507639:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507646:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507652:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507658:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834059.507663:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507671:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507688:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.507699:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834059.509264:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:3639:x1874679406199168:12345-0@lo:103:ldlm_bl.0 Request processed in 1748us (6532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834059.509276:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834059.510177:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406199168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834059.510213:0:17157:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.510234:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834059.510259:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df620723a00/0x996d2fb20dc1e74c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1787834059.512611:0:19462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787834059.521280:0:19462:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787834059.521290:0:19462:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787834059.521456:0:19462:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787834059.521517:0:19462:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787834059.521537:0:19462:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787834059.521566:0:19462:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787834059.526491:0:19462:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787834059.528195:0:19462:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787834059.548425:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834060.565885:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787834060.613673:0:19530:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787834060.613923:0:19530:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787834061.081318:0:17138:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787834061.081547:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df611643000 from 10 10000000:01000000:3.0:1787834061.081554:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787834061.081599:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.081610:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.081620:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834061.081644:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406199296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787834061.081726:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834061.082156:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406199296 00000100:00100000:2.0:1787834061.082164:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406199296 00000100:00100000:2.0:1787834061.082222:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787834061.082230:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:17138:x1874679406199296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834061.082243:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834061.082256:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504ccd400/0x996d2fb20dc1e75a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e753 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.082278:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504ccd400/0x996d2fb20dc1e75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e753 expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.082288:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504ccd400/0x996d2fb20dc1e75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e753 expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.082297:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504ccd400, rc 0) 00000100:00100000:2.0:1787834061.082332:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406199296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834061.082338:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787834061.082409:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503dbed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834061.082428:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406199296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834061.083295:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.083312:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834061.083381:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406199424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787834061.083425:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834061.083466:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503dbed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787834061.083584:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406199424 00000100:00100000:1.0:1787834061.083589:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406199424 00000100:00100000:1.0:1787834061.083629:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787834061.083636:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406199424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787834061.083653:0:17133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787834061.083668:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787834061.083671:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787834061.083765:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406199424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834061.084263:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406199424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787834061.084322:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787834061.084329:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.084338:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834061.084347:0:17138:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787834061.084349:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df504d9f000 from 10 10000000:01000000:3.0:1787834061.084352:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787834061.084373:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.084380:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.084398:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834061.084411:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406199552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787834061.084451:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834061.084643:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787834061.084679:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406199552 00000100:00100000:1.0:1787834061.084684:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406199552 00000100:00100000:1.0:1787834061.084717:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787834061.084724:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406199552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834061.084734:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834061.084746:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df620723800/0x996d2fb20dc1e768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e761 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.085222:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df620723800/0x996d2fb20dc1e768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e761 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.085232:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df620723800/0x996d2fb20dc1e768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e761 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.085240:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723800, rc 0) 00000100:00100000:1.0:1787834061.085280:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:17138:x1874679406199552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 557us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834061.085286:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787834061.085615:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503dbed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834061.085636:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406199552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834061.085652:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.085660:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834061.085713:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406199680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787834061.085770:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834061.086579:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503dbed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787834061.086652:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406199680 00000100:00100000:0.0:1787834061.086660:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406199680 00000100:00100000:0.0:1787834061.086711:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787834061.086719:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50458b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:17138:x1874679406199680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787834061.086738:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787834061.087140:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787834061.087144:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787834061.087272:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50458b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:17138:x1874679406199680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 553us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.087280:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787834061.087546:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406199680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787834061.087608:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787834061.087617:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.087629:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834061.149625:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406199808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787834061.149690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834061.149768:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406199808 00000100:00100000:1.0:1787834061.149775:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406199808 00000100:00100000:1.0:1787834061.149827:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787834061.149836:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406199808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787834061.149863:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787834061.149901:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406199808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834061.149907:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787834061.149925:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787834061.149950:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ff1680 x1874679406199808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834061.149967:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406199808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787834061.540248:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834041/real 1787834041] req@ffff8df504601a40 x1874679406185856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834061.540279:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df504601a40 x1874679406185856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834061.543836:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834041/real 1787834041] req@ffff8df504603c00 x1874679406185984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834061.543883:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df504603c00 x1874679406185984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787834061.544229:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df50454a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834061.544249:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787834061.544254:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406185856:0@lo:8:kworker.0 00000100:00080000:2.0:1787834061.544260:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df63fb42000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834061.544264:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787834061.544267:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504603c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406185984:0@lo:8:kworker.0 00000100:00080000:0.0:1787834061.547241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834061.547248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787834061.547251:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df50454a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834061.547258:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:0.0:1787834061.547263:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787834061.547270:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df50454a800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834061.547291:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df62133a580 x1874679406200192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787834061.547308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834061.547319:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787834061.547321:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df63fb42000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834061.547325:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:0.0:1787834061.547327:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787834061.547330:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df63fb42000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834061.547342:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df62133a940 x1874679406200320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787834061.547373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834061.547377:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787834061.547379:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834061.547383:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df635806800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834061.547395:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df621293480 x1874679406200704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787834061.547462:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406199936:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.547528:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.547567:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406200832:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.547592:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.547611:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406201344:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.547635:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.547658:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787834061.547664:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406200064:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.547689:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.547708:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406200960:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.547727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.547783:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406200448:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.547808:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.547824:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406201088:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.547843:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.547855:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787834061.547861:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406200576:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.547880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.547912:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406201216:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.547935:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.547957:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406199936 00000100:00100000:0.0:1787834061.547964:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406199936 00000100:00100000:0.0:1787834061.548009:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787834061.548018:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3640:x1874679406199936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548064:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3640:x1874679406199936:12345-0@lo:400:kworker.0 Request processed in 47us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.548072:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787834061.548102:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406200832 00000100:00100000:0.0:1787834061.548105:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406200832 00000100:00100000:0.0:1787834061.548124:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406201344 00000100:00100000:0.0:1787834061.548127:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406201344 00000100:00100000:0.0:1787834061.548150:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406200960 00000100:00100000:0.0:1787834061.548152:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406200960 00000100:00100000:0.0:1787834061.548164:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406200448 00000100:00100000:0.0:1787834061.548166:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406200448 00000100:00100000:0.0:1787834061.548175:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406201088 00000100:00100000:0.0:1787834061.548177:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406201088 00000100:00100000:0.0:1787834061.548187:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406201216 00000100:00100000:0.0:1787834061.548189:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406201216 00000100:00100000:0.0:1787834061.548203:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787834061.548231:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406200832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548265:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406200832:12345-0@lo:400:kworker.0 Request processed in 35us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.548271:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787834061.548284:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787834061.548290:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406201344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548317:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406201344:12345-0@lo:400:kworker.0 Request processed in 27us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.548323:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787834061.548334:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787834061.548341:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406200960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548365:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406200960:12345-0@lo:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.548370:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787834061.548381:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787834061.548386:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406200448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548416:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406200448:12345-0@lo:400:kworker.0 Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.548422:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787834061.548433:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787834061.548439:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406201088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548480:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406201088:12345-0@lo:400:kworker.0 Request processed in 42us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.548486:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787834061.548498:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787834061.548511:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406201216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548539:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406201216:12345-0@lo:400:kworker.0 Request processed in 30us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.548545:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787834061.548566:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406200064 00000100:00100000:0.0:1787834061.548569:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406200064 00000100:00100000:0.0:1787834061.548584:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406200576 00000100:00100000:0.0:1787834061.548586:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406200576 00000100:00100000:0.0:1787834061.548596:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787834061.548602:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406200064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548631:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406200064:12345-0@lo:400:kworker.0 Request processed in 29us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.548637:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787834061.548647:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787834061.548652:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406200576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548676:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406200576:12345-0@lo:400:kworker.0 Request processed in 24us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.548682:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787834061.548708:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787834061.548712:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787834061.548741:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6213383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406200576:0@lo:400:kworker.0 00010000:00080000:0.0:1787834061.548779:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621293c00 x1874679406201216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834061.548789:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406201216:0@lo:400:kworker.0 00010000:00080000:0.0:1787834061.548799:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621339680 x1874679406200448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834061.548820:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406200448:0@lo:400:kworker.0 00010000:00080000:0.0:1787834061.548832:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621292580 x1874679406201088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834061.548840:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406201088:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548882:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406200064:0@lo:400:kworker.0 00010000:00080000:0.0:1787834061.548894:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6212930c0 x1874679406200960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834061.548902:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406200960:0@lo:400:kworker.0 00000100:00100000:0.0:1787834061.548910:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406199936:0@lo:400:kworker.0 00010000:00080000:0.0:1787834061.548919:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621292d00 x1874679406200832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834061.548927:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406200832:0@lo:400:kworker.0 00010000:00080000:0.0:1787834061.548937:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6212912c0 x1874679406201344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834061.548945:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406201344:0@lo:400:kworker.0 00000100:00100000:3.0:1787834061.550839:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406200192:0@lo:8:kworker.0 00000100:00100000:3.0:1787834061.550926:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834061.550966:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406200320:0@lo:8:kworker.0 00000100:00100000:3.0:1787834061.550991:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834061.551012:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406200704:0@lo:8:kworker.0 00000100:00100000:3.0:1787834061.551034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834061.551420:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406200192 00000100:00100000:1.0:1787834061.551432:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406200192 00000100:00100000:1.0:1787834061.551469:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406200320 00000100:00100000:1.0:1787834061.551471:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406200320 00000100:00100000:1.0:1787834061.551480:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406200704 00000100:00100000:1.0:1787834061.551482:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406200704 00000100:00100000:1.0:1787834061.551494:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787834061.551501:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874679406200192:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787834061.551530:0:18648:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1787834061.551556:0:18648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1e76f 00002000:00100000:1.0:1787834061.551569:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df502cca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787834061.551573:0:18648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787834061.551576:0:18648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787834061.551644:0:18648:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787834061.551667:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8df502cc9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834061.551716:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874679406200192:12345-0@lo:8:kworker.0 Request processed in 214us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834061.551723:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787834061.551740:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787834061.551744:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874679406200320:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787834061.551783:0:18648:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1787834061.551798:0:18648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1e776 00002000:00100000:1.0:1787834061.551803:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df502ccf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787834061.551807:0:18648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787834061.551809:0:18648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787834061.552032:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787834061.552039:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406200704:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787834061.552186:0:18649:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:0.0:1787834061.552206:0:18649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1e77d 00002000:00100000:0.0:1787834061.552222:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8df60345d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787834061.552232:0:18649:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787834061.552234:0:18649:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787834061.552265:0:18649:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787834061.552280:0:18649:0:(import.c:65:import_set_state_nolock()) ffff8df60345f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787834061.552316:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874679406200704:12345-0@lo:8:kworker.0 Request processed in 277us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.552323:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00002000:00080000:1.0:1787834061.552435:0:18648:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787834061.552453:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8df502ccd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834061.552482:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874679406200320:12345-0@lo:8:kworker.0 Request processed in 736us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834061.552494:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787834061.552598:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df62133a580 x1874679406200192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787834086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834061.552609:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787834061.552616:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787834061.552624:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787834061.552629:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787834061.552631:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df50454a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787834061.552657:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787834061.552663:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406200192:0@lo:8:kworker.0 00010000:00080000:3.0:1787834061.552676:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df62133a940 x1874679406200320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787834086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834061.552685:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787834061.552688:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787834061.552692:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787834061.552696:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787834061.552698:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df63fb42000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787834061.552707:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787834061.552710:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406200320:0@lo:8:kworker.0 00010000:00080000:3.0:1787834061.552722:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621293480 x1874679406200704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787834086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787834061.552743:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787834061.552767:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787834061.552770:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787834061.552773:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787834061.552781:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787834061.552787:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406200704:0@lo:8:kworker.0 00000004:00080000:0.0:1787834061.553489:0:17166:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1787834061.553511:0:17166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb95680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17166:1874679406201600:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787834061.553551:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.553573:0:17166:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50480 going to sleep for 11 seconds 00000004:00080000:0.0:1787834061.553590:0:17167:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787834061.553824:0:17167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 537467072689ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787834061.553832:0:17167:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787834061.554091:0:17165:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787834061.554128:0:17165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 537467376942ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787834061.554132:0:17165:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787834061.554163:0:17168:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1787834061.554178:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17168:1874679406201856:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787834061.554223:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834061.554239:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a845540 going to sleep for 11 seconds 00000004:00080000:1.0:1787834061.554251:0:17884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787834061.554291:0:17884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 537467539637ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787834061.554295:0:17884:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787834061.554311:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787834061.554322:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406201728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787834061.554349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834061.554379:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406201600 00000100:00100000:1.0:1787834061.554385:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406201600 00000100:00100000:1.0:1787834061.554431:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406201856 00000100:00100000:1.0:1787834061.554434:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406201856 00000100:00100000:1.0:1787834061.554458:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787834061.554465:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17166:x1874679406201600:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787834061.554788:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406201728 00000100:00100000:1.0:1787834061.554793:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406201728 00000100:00100000:1.0:1787834061.554821:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787834061.554826:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1874679406201728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787834061.554847:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787834061.555323:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1874679406201728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 495us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834061.555341:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787834061.555369:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787834061.555376:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17168:x1874679406201856:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787834061.558258:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406201472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787834061.558333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787834061.558473:0:17885:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787834061.558494:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb94780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17885:1874679406202112:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787834061.558524:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.558536:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834061.558682:0:18649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787834061.558689:0:18649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787834061.560333:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406202112 00000100:00100000:0.0:1787834061.560345:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406202112 00000100:00100000:0.0:1787834061.560452:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787834061.560479:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17885:x1874679406202112:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1787834061.561984:0:18650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787834061.561995:0:18650:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787834061.562001:0:18650:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:0.0:1787834061.565297:0:17121:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787834061.565321:0:17121:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787834061.567735:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406201472 00000100:00100000:3.0:1787834061.567772:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406201472 00000100:00100000:3.0:1787834061.567817:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787834061.567845:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504602940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874679406201472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787834061.567869:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787834061.568018:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504602940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874679406201472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (9683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834061.568025:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787834061.568987:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787834061.568993:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787834061.569005:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787834061.569027:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406201984:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787834061.569271:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb97480 x1874679406201472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834061.569303:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406201472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787834061.569697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.570047:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406201984 00000100:00100000:0.0:1787834061.571033:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406201984 00000100:00100000:0.0:1787834061.571090:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834061.571098:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504603c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1874679406201984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787834061.571119:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787834061.571190:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504603c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1874679406201984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.571198:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:0.0:1787834061.571233:0:19578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787834061.571239:0:19578:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787834061.571277:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17885:x1874679406202112:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10817us (12751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.571284:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787834061.571319:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb94780 x1874679406202112/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787834077 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834061.571333:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb94780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17885:1874679406202112:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787834061.571343:0:17885:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787834061.571375:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb94780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17885:1874679406202240:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787834061.571404:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834061.571424:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834061.571437:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406202240 00000100:00100000:0.0:1787834061.571440:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406202240 00000100:00100000:0.0:1787834061.571466:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787834061.571473:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17885:x1874679406202240:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787834061.571502:0:18649:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1787834061.571536:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17885:x1874679406202240:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.571542:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787834061.571568:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb94780 x1874679406202240/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787834077 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834061.571577:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb94780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17885:1874679406202240:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787834061.571585:0:17885:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00010000:00080000:3.0:1787834061.572006:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fb96d00 x1874679406201984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834061.572023:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406201984:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787834061.587429:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502ff03c0 x1874679406201728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834061.587456:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406201728:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1787834061.589321:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.589334:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.589351:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.589356:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.589363:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.589381:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.589393:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.589401:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.589475:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787834061.590226:0:17874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:2.0:1787834061.590611:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.590620:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.590632:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.590637:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.590642:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.590657:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.590667:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.590675:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.594040:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834061.602977:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.602990:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.602995:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.603006:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.603029:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.603036:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1e784 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.603073:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834061.603077:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.603083:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccce00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.603087:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.603094:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.603115:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.603123:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.603125:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.603127:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.603372:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787834061.603403:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c63f012a/0x996d2fb20dc1e78b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.603894:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.604262:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.604327:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.604334:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604346:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.604350:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.604357:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604369:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604379:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604387:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604401:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787834061.604503:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834061.604514:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604522:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504cccc00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.604525:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604533:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604546:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604552:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000989fa494/0x996d2fb20dc1e792 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604565:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.604567:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.604568:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.604809:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.604815:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604823:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.604826:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.604830:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604848:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604855:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604862:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.604877:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787834061.605361:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.605368:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.605376:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.605379:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.605382:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.605391:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.605398:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.605416:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.605430:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787834061.606400:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.606410:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.606422:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.606426:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.606431:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.606442:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.606451:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.606457:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.606622:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:1.0:1787834061.607545:0:18648:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787834061.607555:0:18648:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787834061.607560:0:18648:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00010000:00010000:3.0:1787834061.618012:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787834061.618027:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.618041:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccd800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.618047:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618190:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787834061.618197:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618205:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccda00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.618219:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618230:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618251:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618258:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd52c206/0x996d2fb20dc1e7a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618331:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834061.618335:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618341:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccc600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.618344:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618351:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618360:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618366:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c50ad7b/0x996d2fb20dc1e7a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.618378:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.618380:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.618382:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.618584:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.618599:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.618605:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de65e3a4/0x996d2fb20dc1e799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.623381:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.623388:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.623392:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834061.631508:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.631520:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.631538:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.631543:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.631550:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.631566:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.631577:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.631585:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.631608:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834061.633265:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834061.633275:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.633293:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.633297:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.633308:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.633328:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.633336:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b62078c/0x996d2fb20dc1e7ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.633355:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.633356:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.633358:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834061.636280:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.636294:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636318:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.636322:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.636328:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636341:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636352:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636360:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636378:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834061.636693:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.636699:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636708:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.636712:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636722:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636764:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636772:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f99944d/0x996d2fb20dc1e7b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.636788:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.636790:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.636791:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.637939:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834061.638322:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.638332:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638346:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.638351:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.638356:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638368:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638377:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638385:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638420:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834061.638587:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.638593:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638602:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.638606:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638615:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638631:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638639:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1e7bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.638654:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.638656:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.638657:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.639290:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.639306:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639317:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.639321:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.639326:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639338:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639346:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639353:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639369:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787834061.639697:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.639703:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639711:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.639714:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.639718:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639727:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639741:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639764:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639778:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787834061.639856:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834061.639862:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639870:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccd200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.639874:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.639883:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640286:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640295:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e651f033/0x996d2fb20dc1e7c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787834061.640345:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.640356:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640363:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.640367:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.640371:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640381:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640388:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640396:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640407:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787834061.640502:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834061.640508:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640515:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fa00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.640519:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640527:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640545:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640551:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000206805cf/0x996d2fb20dc1e7ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640565:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834061.640568:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640574:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.640577:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640583:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640592:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640598:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e7d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.640607:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.640609:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.640615:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.641024:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.641032:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641041:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.641045:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.641063:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641074:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641083:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641090:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641104:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787834061.641197:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834061.641202:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641219:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.641222:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641240:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641252:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641259:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f9f5508/0x996d2fb20dc1e7d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.641274:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.641275:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.641277:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.645829:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.645847:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.646027:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.646037:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787834061.647012:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.647023:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647068:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.647073:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.647081:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647096:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647106:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647114:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647133:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787834061.647791:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.647799:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647808:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.647812:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.647816:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647826:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647847:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647854:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.647869:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787834061.648270:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.648276:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648285:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.648288:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.648293:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648302:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648309:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648316:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648341:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787834061.648600:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.648605:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648614:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.648617:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.648621:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648630:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648637:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648645:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.648652:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787834061.648875:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.648878:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.648883:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.648908:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.648916:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.648930:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.648939:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787834061.649624:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.649633:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.649643:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.649653:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.649658:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.649668:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.649676:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.649684:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.649693:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1787834061.650067:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.650073:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650083:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.650085:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.650090:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650098:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650106:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650112:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650120:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1787834061.650228:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787834061.650237:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650252:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.650256:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650265:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650284:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650292:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1e7e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650312:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787834061.650316:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650322:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fdc00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.650326:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650333:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650343:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650357:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1e7ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650372:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787834061.650375:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650381:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fd000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.650385:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650393:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650403:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650410:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20b6f69/0x996d2fb20dc1e7f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650436:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787834061.650441:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650448:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.650458:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650509:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650521:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650529:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf9842e0/0x996d2fb20dc1e7fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650544:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787834061.650548:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650554:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.650557:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650565:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650575:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650582:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e7df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650603:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834061.650606:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650613:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fd200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.650617:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650624:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650634:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650641:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004349c264/0x996d2fb20dc1e802 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650653:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834061.650657:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650663:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.650666:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650684:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650695:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650702:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047b17587/0x996d2fb20dc1e809 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.650715:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.650717:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.650719:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.651252:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.651260:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.651270:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.651274:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.651278:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.651288:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.651296:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.651310:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.651326:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787834061.651803:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834061.651810:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.651830:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.651833:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.651841:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.651856:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.651863:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1e810 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.651877:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.651879:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.651880:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834061.653452:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.653467:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.653482:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.653487:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.653492:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.653505:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.653516:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.653531:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.653547:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787834061.654178:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.654187:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.654198:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.654201:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.654216:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.654227:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.654236:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.654244:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.654255:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787834061.654808:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787834061.654817:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.654826:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.654831:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.654841:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.654865:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.654872:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a8b08a4/0x996d2fb20dc1e817 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787834061.655046:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834061.655165:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834061.655170:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.655178:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.655181:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.655189:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.655200:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.655216:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003835b567/0x996d2fb20dc1e81e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.655229:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.655230:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.655237:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834061.655345:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.655352:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.655362:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.655366:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.655371:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.655381:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.655389:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.655396:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.655417:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787834061.655672:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.655687:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.655690:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.655695:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.655705:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.655713:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.655719:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.655727:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787834061.656883:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.656909:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.656931:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.656935:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.656939:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.656951:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.656960:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.656967:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.656978:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787834061.657129:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787834061.657137:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657146:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.657150:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657159:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657186:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657194:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e227f663/0x996d2fb20dc1e82c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657224:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787834061.657229:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657235:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fc00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.657238:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657245:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657254:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657261:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003447f073/0x996d2fb20dc1e825 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657275:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.657279:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657291:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.657294:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657301:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657312:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657318:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1e833 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.657330:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.657333:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.657334:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.657508:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.657514:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.657522:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.657526:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.657530:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.657540:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.657559:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.657566:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.657586:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787834061.657777:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406202368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834061.657844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787834061.658120:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834061.658127:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.658136:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.658140:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.658149:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.658162:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.658169:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000870dd72a/0x996d2fb20dc1e83a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.658185:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.658187:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.658188:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834061.658857:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.658865:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.658876:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.658879:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.658898:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.658911:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.658929:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.658937:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.658955:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834061.659312:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.659318:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659327:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fd800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.659331:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659339:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659352:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659359:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8463cba/0x996d2fb20dc1e841 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659376:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.659382:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.659384:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834061.659672:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.659678:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659687:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.659690:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.659695:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659704:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659713:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659720:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659735:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834061.659860:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.659866:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659873:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fda00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.659876:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659896:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659908:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659915:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e0ca524/0x996d2fb20dc1e848 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.659930:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.659932:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.659934:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834061.660293:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.660300:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660308:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.660312:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.660316:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660325:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660334:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660348:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660361:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834061.660458:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.660463:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660470:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.660474:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660481:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660493:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660500:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000583ccbfb/0x996d2fb20dc1e84f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.660514:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.660515:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.660517:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.663317:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834061.663414:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834061.663422:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663439:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787834061.663444:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834061.663450:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663463:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663472:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663480:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663496:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834061.663674:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.663680:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663688:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.663692:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663711:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663728:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663736:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c38a7b3e/0x996d2fb20dc1e856 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.663771:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.663773:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.663775:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834061.670708:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834061.670725:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.670745:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1787834061.670764:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834061.670772:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.670787:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.670807:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.670815:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.670843:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787834061.671795:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834061.671803:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.671815:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1787834061.671819:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834061.671824:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.671835:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.671843:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.671850:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.671883:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787834061.672600:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834061.672608:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.672618:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1787834061.672621:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834061.672627:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.672637:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.672646:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.672654:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.672662:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787834061.673357:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787834061.673367:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673378:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.673383:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673404:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673423:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673432:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a5f8d8/0x996d2fb20dc1e85d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673448:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787834061.673452:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673459:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.673461:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673468:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673478:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673485:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db962ec7/0x996d2fb20dc1e864 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673507:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834061.673510:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673517:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.673519:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673527:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673536:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673542:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d820f0c/0x996d2fb20dc1e86b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.673551:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.673553:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.673555:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834061.673877:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834061.673899:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.673909:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1787834061.673919:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834061.673925:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.673935:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.673942:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.673948:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.673967:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787834061.674344:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406202368 00000100:00100000:2.0:1787834061.674354:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406202368 00000100:00100000:2.0:1787834061.674406:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787834061.674416:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406202368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787834061.674449:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834061.674530:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406202368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (16686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834061.674537:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787834061.674569:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406202496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834061.674609:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834061.674668:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406202368:0@lo:41:osp-pre-1-0.0 00002000:00010000:2.0:1787834061.674742:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.674747:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.674786:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.674789:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.674794:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.674804:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.674812:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.674820:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.674830:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1787834061.674983:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406202496 00000100:00100000:2.0:1787834061.674988:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406202496 00000100:00100000:2.0:1787834061.675010:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787834061.675016:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406202496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787834061.675035:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787834061.675081:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406202496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834061.675088:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787834061.675116:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406202496:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787834061.675136:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834061.675147:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675155:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.675159:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675167:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675180:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675187:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d0b816d/0x996d2fb20dc1e872 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675203:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834061.675217:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675223:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ec00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.675226:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675232:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675254:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675260:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1488f60/0x996d2fb20dc1e879 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675275:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.675276:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.675278:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.675585:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.675591:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675600:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.675604:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.675608:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675619:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675627:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675634:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.675660:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787834061.676370:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.676377:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676387:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.676390:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.676395:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676404:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676411:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676417:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676425:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787834061.676779:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.676785:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676794:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.676803:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.676807:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676816:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676823:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676830:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.676839:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787834061.680231:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787834061.680243:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680256:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ee00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.680260:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680271:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680293:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680314:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a1f356e/0x996d2fb20dc1e880 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680340:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834061.680344:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680350:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fe00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.680353:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680360:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680370:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680376:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049d37b55/0x996d2fb20dc1e887 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680388:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834061.680391:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680398:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.680406:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680413:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680422:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680429:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dee45b7/0x996d2fb20dc1e88e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.680440:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.680442:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.680444:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.680833:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.680841:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.680853:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.680857:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.680862:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.680873:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.680882:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.680909:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.680927:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834061.683302:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834061.683315:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683327:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.683331:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683341:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683359:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683379:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e199eee4/0x996d2fb20dc1e895 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683402:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.683403:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.683405:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834061.683492:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834061.683499:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683510:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1787834061.683515:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834061.683520:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683531:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683541:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683548:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683563:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834061.683725:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834061.683735:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683742:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.683746:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683771:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683782:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683790:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a2906b/0x996d2fb20dc1e89c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.683804:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.683806:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.683807:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.684109:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.684115:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684123:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.684125:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.684129:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684139:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684146:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684153:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684172:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787834061.684277:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834061.684282:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684295:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.684299:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684307:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684318:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684325:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1005898/0x996d2fb20dc1e8a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.684338:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.684339:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.684341:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.685176:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.685342:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.685352:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.685364:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.685368:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.685372:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.685382:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.685399:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.685406:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.685422:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787834061.689803:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834061.689819:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.689834:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.689846:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.689858:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.689878:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.689898:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1e8aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.689919:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.689921:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.689923:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.690372:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.690381:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690393:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.690397:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.690404:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690416:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690425:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690433:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690465:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787834061.690656:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834061.690662:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690671:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.690675:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690683:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690695:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690702:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047b17587/0x996d2fb20dc1e8b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.690717:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.690718:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.690720:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.691180:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.691186:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691195:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.691216:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.691222:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691232:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691241:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691248:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691264:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787834061.691531:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.691537:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691544:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.691547:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.691551:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691560:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691567:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691581:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691593:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1787834061.691623:0:18650:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1787834061.691723:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17168:x1874679406201856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 136343us (137494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834061.691733:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787834061.691818:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17168:1874679406201856:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787834061.691835:0:17168:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1787834061.691879:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aa580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17168:1874679406202624:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787834061.691930:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834061.691955:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63436d780 going to sleep for 11 seconds 00010000:00010000:2.0:1787834061.691968:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834061.691973:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691981:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.691985:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.691993:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.692019:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.692026:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fdd4d4b/0x996d2fb20dc1e8b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.692043:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834061.692047:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.692053:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834061.692067:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.692076:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.692084:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.692090:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f9f5508/0x996d2fb20dc1e8bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.692100:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.692102:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.692108:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834061.695680:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834061.695696:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.695712:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1787834061.695717:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834061.695724:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.695775:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.695788:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.695795:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.695815:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787834061.697192:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834061.697204:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.697228:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.697232:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.697243:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.697263:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.697280:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c51d08f/0x996d2fb20dc1e8c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.697301:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.697303:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.697304:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834061.697321:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406202624 00000100:00100000:0.0:1787834061.697332:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406202624 00000100:00100000:0.0:1787834061.697379:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787834061.697388:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17168:x1874679406202624:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787834061.697428:0:18649:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:3.0:1787834061.697838:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834061.697845:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.697859:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1787834061.697863:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834061.697869:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.697880:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.697889:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.697907:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.697924:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834061.699559:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.699570:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.699580:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.699584:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.699594:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.699612:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.699639:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfda83ff/0x996d2fb20dc1e8cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.699665:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.699667:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.699669:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834061.701633:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834061.701646:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.701966:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1787834061.701971:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834061.701978:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.701992:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.702001:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.702008:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.702025:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834061.702205:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834061.702221:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.702234:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.702239:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.702249:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.702265:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.702273:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090801bb7/0x996d2fb20dc1e8d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.702290:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.702292:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.702294:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.702631:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834061.703426:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834061.703436:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.703450:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1787834061.703453:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834061.703458:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.703470:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.703486:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.703494:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.703515:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787834061.703925:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834061.703933:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.703942:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834061.703946:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.703956:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.703972:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.703991:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011fa4110/0x996d2fb20dc1e8db lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.704007:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.704009:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.704011:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834061.708324:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834061.708341:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.708358:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787834061.708363:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834061.708370:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.708384:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.708395:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.708403:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834061.708548:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1787834061.709905:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787834061.709950:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787834061.709955:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787834061.710305:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17168:x1874679406202624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12914us (18370us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787834061.710318:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787834061.710366:0:17168:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787834061.710373:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aa580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17168:1874679406202624:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787834061.710388:0:17168:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00002000:00010000:0.0:1787834061.710516:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834061.710524:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.710539:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=537s v=(0 0) 00010000:00010000:0.0:1787834061.710543:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834061.710549:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.710562:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.710572:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.710580:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713828:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834061.713842:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713857:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.713861:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713873:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713904:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713913:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075e20517/0x996d2fb20dc1e8e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713935:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834061.713955:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713962:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.713966:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713973:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713984:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.713991:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.713993:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.713995:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834061.714534:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834061.718680:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787834061.718694:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f78e4b6/0x996d2fb20dc1e8e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.719151:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787834061.720248:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834061.720259:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.720275:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=537s v=(0 0) 00010000:00010000:0.0:1787834061.720279:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834061.720285:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.720298:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.720306:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.720313:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.720334:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834061.720992:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.721001:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.721010:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.721014:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.721023:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.721041:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.721048:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c833875a/0x996d2fb20dc1e8f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.722165:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.722170:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.722172:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787834061.722327:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834061.722336:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.722356:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=537s v=(0 0) 00010000:00010000:0.0:1787834061.722360:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834061.722366:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.722378:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.722386:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.722394:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.722423:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834061.722955:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834061.722963:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.722972:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834061.722977:0:19480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.722986:0:19480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.723003:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.723011:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efdac271/0x996d2fb20dc1e8f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834061.723028:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.723030:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834061.723032:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787834061.723459:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834061.723466:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.723476:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=537s v=(0 0) 00010000:00010000:0.0:1787834061.723479:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834061.723484:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.723494:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.723518:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.723525:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834061.723548:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787834061.723590:0:18648:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1787834061.723706:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17166:x1874679406201600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 169215us (170128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834061.723716:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787834061.725301:0:17166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb95680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17166:1874679406201600:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787834061.725318:0:17166:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787834061.725361:0:17166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a45e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17166:1874679406202752:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787834061.725414:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834061.725444:0:17166:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5039db780 going to sleep for 11 seconds 00010000:00010000:3.0:1787834061.725670:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834061.725678:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.725688:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834061.725692:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.725703:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.725734:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.725742:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed6ce61f/0x996d2fb20dc1e8fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834061.725787:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.725790:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834061.725791:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834061.725914:0:19578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406202752 00000100:00100000:0.0:1787834061.725922:0:19578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406202752 00000100:00100000:0.0:1787834061.725973:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834061.725982:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17166:x1874679406202752:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787834061.726022:0:19578:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1787834061.742381:0:18644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1787834061.742430:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787834061.742668:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17166:x1874679406202752:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16674us (17240us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787834061.742679:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787834061.744899:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787834061.744915:0:17166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a45e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17166:1874679406202752:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787834061.744934:0:17166:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1787834062.618169:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834063.638161:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787834063.831577:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787834064.663399:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834065.687215:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834066.266140:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787834066.266168:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406202880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787834066.266254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.267117:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406202880 00000100:00100000:2.0:1787834066.267128:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406202880 00000100:00100000:2.0:1787834066.267196:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787834066.267207:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406202880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787834066.267239:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834066.267294:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406202880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.267300:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787834066.268207:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406202880:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787834066.268359:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787834066.711953:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834066.778853:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb95a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17885:1874679406203136:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787834066.778934:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834066.778990:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63a8696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834066.779007:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787834066.779021:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406203008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787834066.779058:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834066.782453:0:19277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406203136 00000100:00100000:1.0:1787834066.782463:0:19277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406203136 00000100:00100000:1.0:1787834066.782523:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787834066.782534:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17885:x1874679406203136:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787834066.782575:0:19277:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00080000:1.0:1787834066.782727:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787834066.784763:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406203648:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.784829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.784875:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406204160:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.784899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.784915:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406204672:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785084:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787834066.785090:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406203520:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785135:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406204032:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785188:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406204544:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785269:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406203008 00000100:00100000:2.0:1787834066.785276:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406203008 00000100:00100000:2.0:1787834066.785319:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787834066.785327:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874679406203008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787834066.785349:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787834066.785503:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874679406203008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 177us (6444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.785510:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787834066.785534:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406203264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787834066.785557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785571:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406203776:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785607:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406204288:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785639:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787834066.785686:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406203392:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785734:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406203904:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785774:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785784:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406204416:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.785829:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406203648 00000100:00100000:2.0:1787834066.785832:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406203648 00000100:00100000:2.0:1787834066.785863:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406203776 00000100:00100000:2.0:1787834066.785865:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406203776 00000100:00100000:2.0:1787834066.785877:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787834066.785882:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406203648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.785926:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406203648:12345-0@lo:400:kworker.0 Request processed in 43us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.785932:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787834066.787042:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787834066.787053:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406203776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.787110:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406203776:12345-0@lo:400:kworker.0 Request processed in 61us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.787117:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787834066.788085:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406203008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787834066.788121:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406204160 00000100:00100000:2.0:1787834066.788126:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406204160 00000100:00100000:2.0:1787834066.788153:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406204672 00000100:00100000:2.0:1787834066.788155:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406204672 00000100:00100000:2.0:1787834066.788168:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406204544 00000100:00100000:2.0:1787834066.788702:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406204544 00000100:00100000:2.0:1787834066.788731:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406204288 00000100:00100000:2.0:1787834066.788734:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406204288 00000100:00100000:2.0:1787834066.788744:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406203904 00000100:00100000:2.0:1787834066.788747:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406203904 00000100:00100000:2.0:1787834066.788771:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406204416 00000100:00100000:2.0:1787834066.788774:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406204416 00000100:00100000:2.0:1787834066.788797:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787834066.788805:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406204160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.788870:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406204160:12345-0@lo:400:kworker.0 Request processed in 66us (3970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.788876:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787834066.788889:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787834066.788894:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406204672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.788924:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406204672:12345-0@lo:400:kworker.0 Request processed in 30us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.788930:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787834066.790473:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787834066.790490:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406204544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.790571:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406204544:12345-0@lo:400:kworker.0 Request processed in 87us (5342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.790579:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787834066.790598:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787834066.790603:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406204288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.790634:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406204288:12345-0@lo:400:kworker.0 Request processed in 30us (5008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.790639:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787834066.791764:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787834066.791775:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406203904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.792324:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406203904:12345-0@lo:400:kworker.0 Request processed in 551us (6547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.792332:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787834066.792351:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787834066.792358:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406204416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.792876:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406204416:12345-0@lo:400:kworker.0 Request processed in 518us (7067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.792883:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787834066.792918:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406203520 00000100:00100000:2.0:1787834066.792926:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406203520 00000100:00100000:2.0:1787834066.794541:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406204032 00000100:00100000:2.0:1787834066.794552:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406204032 00000100:00100000:2.0:1787834066.794574:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787834066.794584:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406203520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.794660:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406203520:12345-0@lo:400:kworker.0 Request processed in 77us (9543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.794667:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787834066.794682:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787834066.794688:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406204032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.794718:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406204032:12345-0@lo:400:kworker.0 Request processed in 30us (9559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.794724:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787834066.794773:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406203264 00000100:00100000:2.0:1787834066.794778:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406203264 00000100:00100000:2.0:1787834066.794799:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834066.794807:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406203264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787834066.794821:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834066.794855:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406203264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (9296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.794861:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834066.794887:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406203392 00000100:00100000:2.0:1787834066.794891:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406203392 00000100:00100000:2.0:1787834066.794919:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787834066.794925:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3640:x1874679406203392:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787834066.798318:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787834066.798325:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787834066.798328:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787834066.798331:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787834066.798468:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3640:x1874679406203392:12345-0@lo:400:kworker.0 Request processed in 2450us (11661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.798482:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787834066.798578:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406203520:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.798591:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406204032:0@lo:400:kworker.0 00010000:00080000:2.0:1787834066.798604:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045ab840 x1874679406204544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834066.798616:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406204544:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.798629:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406203648:0@lo:400:kworker.0 00010000:00080000:2.0:1787834066.798640:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045a8b40 x1874679406204160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834066.798648:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406204160:0@lo:400:kworker.0 00010000:00080000:2.0:1787834066.798658:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045aa940 x1874679406204672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834066.798665:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406204672:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.798710:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406204800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834066.798835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.798902:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406203392:0@lo:400:kworker.0 00000100:00100000:3.0:1787834066.801543:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406204800 00000100:00100000:3.0:1787834066.801555:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406204800 00000100:00100000:3.0:1787834066.801648:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787834066.801686:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406204800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787834066.801723:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787834066.801826:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406204800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834066.801833:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787834066.801906:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406204928:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1787834066.802105:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045a9a40 x1874679406203904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834066.802122:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406203904:0@lo:400:kworker.0 00010000:00080000:2.0:1787834066.802136:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045a8780 x1874679406204416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834066.802158:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406204416:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.802523:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406203264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787834066.802538:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406203776:0@lo:400:kworker.0 00010000:00080000:2.0:1787834066.802550:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045a9e00 x1874679406204288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834066.802559:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406204288:0@lo:400:kworker.0 00000100:00100000:2.0:1787834066.802603:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406204800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834066.802625:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406205056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787834066.802655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834066.802703:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406205056 00000100:00100000:2.0:1787834066.802708:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406205056 00000100:00100000:2.0:1787834066.802740:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834066.802748:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406205056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787834066.802811:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787834066.802875:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406205056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834066.802882:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834066.802928:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406205056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787834066.804340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834066.805304:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406204928 00000100:00100000:3.0:1787834066.805314:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406204928 00000100:00100000:3.0:1787834066.805362:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787834066.805372:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406204928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787834066.807628:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787834066.807729:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406204928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2356us (5780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834066.807740:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787834066.808012:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406204928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787834066.838005:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1874679406203136:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55468us (59065us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787834066.838137:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787834066.838234:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb95a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17885:1874679406203136:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787834066.838249:0:17885:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787834066.838290:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1874679406205184:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787834066.838328:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834066.838350:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5039db0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834066.838370:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406205184 00000100:00100000:1.0:1787834066.838375:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406205184 00000100:00100000:1.0:1787834066.838423:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787834066.838431:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1874679406205184:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787834066.838476:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1874679406205184:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834066.838493:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787834066.838523:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a44780 x1874679406205184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787834082 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834066.838533:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1874679406205184:0@lo:900:osp-pre-1-1.0 00000001:02000400:3.0:1787834066.874707:0:19821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787834067.734023:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787834067.818952:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:1.0:1787834068.002074:0:19873:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787834068.002981:0:19873:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787834068.759629:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787834068.843731:0:19923:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787834068.844025:0:19923:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787834069.134839:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834069.134945:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382002688 00000100:00100000:0.0:1787834069.134954:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382002688 00000100:00100000:0.0:1787834069.135008:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:0.0:1787834069.135023:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1874679382002688:12345-192.168.203.17@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787834069.135050:0:17133:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 7c8abb39-d835-4001-b54a-d8ba07846eed@192.168.203.17@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1787834069.135087:0:17133:0:(genops.c:1385:class_connect()) connect: client 7c8abb39-d835-4001-b54a-d8ba07846eed, cookie 0x996d2fb20dc1e905 00000100:00080000:0.0:1787834069.135232:0:17133:0:(import.c:65:import_set_state_nolock()) ffff8df60345b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787834069.135305:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+5:2397:x1874679382002688:12345-192.168.203.17@tcp:250:mount.lustre.0 Request processed in 281us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.135313:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:3.0:1787834069.149303:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834069.149400:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382002816 00000100:00100000:0.0:1787834069.149410:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382002816 00000100:00100000:0.0:1787834069.149469:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:0.0:1787834069.149480:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50458bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+5:14891:x1874679382002816:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787834069.149497:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834069.149514:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504677600/0x996d2fb20dc1e90c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ef35 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834069.149543:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677600/0x996d2fb20dc1e90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef35 expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834069.149554:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504677600/0x996d2fb20dc1e90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef35 expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834069.149563:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677600, rc 0) 00000100:00100000:0.0:1787834069.149649:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50458bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+6:14891:x1874679382002816:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 170us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.149656:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:1.0:1787834069.158493:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.158627:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382002944 00000100:00100000:2.0:1787834069.158637:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382002944 00000100:00100000:2.0:1787834069.158691:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:2.0:1787834069.158701:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+6:14891:x1874679382002944:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787834069.158874:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+6:14891:x1874679382002944:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 174us (391us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787834069.158883:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:3.0:1787834069.167676:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.167882:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382003072 00000100:00100000:2.0:1787834069.167892:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382003072 00000100:00100000:2.0:1787834069.167953:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:2.0:1787834069.167963:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50458a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+6:14891:x1874679382003072:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787834069.167979:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834069.167997:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1e913 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ef3c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.168037:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1e913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef3c expref: 7 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.168049:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1e913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef3c expref: 7 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.168070:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4ee00, rc 0) 00000100:00100000:2.0:1787834069.168129:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50458a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+7:14891:x1874679382003072:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 167us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.168136:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:3.0:1787834069.170043:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834069.170179:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382003200 00000100:00100000:0.0:1787834069.170188:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382003200 00000100:00100000:0.0:1787834069.170240:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:0.0:1787834069.170249:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+7:14891:x1874679382003200:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787834069.170382:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14891:x1874679382003200:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 134us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.170389:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:1.0:1787834069.179805:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834069.179927:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382003328 00000100:00100000:0.0:1787834069.179937:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382003328 00000100:00100000:0.0:1787834069.179993:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:0.0:1787834069.180015:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50458b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14891:x1874679382003328:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787834069.180177:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50458b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14891:x1874679382003328:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 168us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.180186:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:3.0:1787834069.191261:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.191436:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382003456 00000100:00100000:2.0:1787834069.191446:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382003456 00000100:00100000:2.0:1787834069.191504:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:2.0:1787834069.191514:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14910:x1874679382003456:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787834069.191686:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14910:x1874679382003456:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 172us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.191700:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:2.0:1787834069.215384:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834069.219264:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382003584 00000100:00100000:1.0:1787834069.219279:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382003584 00000100:00100000:1.0:1787834069.219368:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00100000:1.0:1787834069.219377:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14910:x1874679382003584:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787834069.219547:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14910:x1874679382003584:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 169us (4173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834069.219554:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00100000:1.0:1787834069.225877:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834069.225962:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382003712 00000100:00100000:0.0:1787834069.225972:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382003712 00000100:00100000:0.0:1787834069.226038:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:0.0:1787834069.226049:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14910:x1874679382003712:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787834069.226218:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14910:x1874679382003712:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 170us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.226226:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:3.0:1787834069.229101:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.229333:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382003840 00000100:00100000:2.0:1787834069.229344:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382003840 00000100:00100000:2.0:1787834069.229400:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:2.0:1787834069.229411:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+8:14891:x1874679382003840:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787834069.229428:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834069.229448:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1e91a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ef6d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.229478:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1e91a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef6d expref: 9 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.229489:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1e91a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef6d expref: 9 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.229499:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f800, rc 0) 00000100:00100000:2.0:1787834069.229561:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+9:14891:x1874679382003840:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 151us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.229568:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:2.0:1787834069.233575:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834069.237400:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382003968 00000100:00100000:1.0:1787834069.237416:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382003968 00000100:00100000:0.0:1787834069.241363:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:0.0:1787834069.241400:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+9:14891:x1874679382003968:12345-192.168.203.17@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787834069.241426:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787834069.241441:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787834069.241445:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787834069.241449:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787834069.241452:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787834069.241454:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787834069.243460:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+9:14891:x1874679382003968:12345-192.168.203.17@tcp:256:mount.lustre.0 Request processed in 2065us (9886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.243473:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:3.0:1787834069.247895:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834069.248223:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382004096 00000100:00100000:0.0:1787834069.248233:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382004096 00000100:00100000:0.0:1787834069.248327:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:0.0:1787834069.248337:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+9:14891:x1874679382004096:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787834069.248354:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834069.248371:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91ef74 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834069.248404:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef74 expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834069.248416:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef74 expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834069.248426:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676000, rc 0) 00000100:00100000:0.0:1787834069.248488:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+10:14891:x1874679382004096:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 153us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.248495:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:3.0:1787834069.256555:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834069.259469:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382004224 00000100:00100000:0.0:1787834069.259484:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382004224 00000100:00100000:0.0:1787834069.259556:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 127 00000100:00100000:0.0:1787834069.259566:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fc4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+10:14891:x1874679382004224:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787834069.259779:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fc4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+10:14891:x1874679382004224:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 185us (3203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.259787:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 127 00000100:00100000:1.0:1787834069.262676:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834069.262880:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382004352 00000100:00100000:0.0:1787834069.262888:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382004352 00000100:00100000:0.0:1787834069.262942:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:0.0:1787834069.262950:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502517850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+10:14891:x1874679382004352:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787834069.263292:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502517850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+10:14891:x1874679382004352:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 162us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.263302:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:3.0:1787834069.266714:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.267412:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382004480 00000100:00100000:2.0:1787834069.267421:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382004480 00000100:00100000:2.0:1787834069.267474:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:2.0:1787834069.267484:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+10:14915:x1874679382004480:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787834069.267689:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+10:14915:x1874679382004480:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 205us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.267704:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:3.0:1787834069.269876:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000040:00080000:1.0:1787834069.270531:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787834069.270843:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382004608 00000100:00100000:0.0:1787834069.270852:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382004608 00000100:00100000:0.0:1787834069.270907:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:0.0:1787834069.270917:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502514c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+10:14915:x1874679382004608:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787834069.271108:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502514c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+10:14915:x1874679382004608:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 191us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834069.271116:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:1.0:1787834069.283099:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834069.283196:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.283279:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382004736 00000100:00100000:2.0:1787834069.283290:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382004736 00000100:00100000:2.0:1787834069.283335:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382004992 00000100:00100000:2.0:1787834069.283338:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382004992 00000100:00100000:2.0:1787834069.283431:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:2.0:1787834069.283440:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1874679382004736:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787834069.283471:0:18167:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 4903173d-3c15-42de-bfe8-e4a9090d66c7@192.168.203.17@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1787834069.283526:0:18167:0:(genops.c:1385:class_connect()) connect: client 4903173d-3c15-42de-bfe8-e4a9090d66c7, cookie 0x996d2fb20dc1e928 00000004:00100000:2.0:1787834069.283553:0:18167:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787834069.283813:0:18167:0:(import.c:65:import_set_state_nolock()) ffff8df60665e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834069.283894:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2397:x1874679382004736:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 453us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.283902:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:2.0:1787834069.283922:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:2.0:1787834069.283927:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1874679382004992:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787834069.283942:0:18167:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 4903173d-3c15-42de-bfe8-e4a9090d66c7@192.168.203.17@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1787834069.283971:0:18167:0:(genops.c:1385:class_connect()) connect: client 4903173d-3c15-42de-bfe8-e4a9090d66c7, cookie 0x996d2fb20dc1e92f 00000004:00100000:2.0:1787834069.283984:0:18167:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787834069.284114:0:18167:0:(import.c:65:import_set_state_nolock()) ffff8df503f66000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834069.284142:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2397:x1874679382004992:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 213us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.284149:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:3.0:1787834069.293460:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834069.293507:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.293596:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382004864 00000100:00100000:2.0:1787834069.293606:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382004864 00000100:00100000:2.0:1787834069.293704:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382005248 00000100:00100000:2.0:1787834069.293707:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382005248 00000100:00100000:2.0:1787834069.293740:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:2.0:1787834069.293774:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:0:x1874679382004864:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787834069.293822:0:17141:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787834069.293924:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:0:x1874679382004864:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 176us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.293931:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:2.0:1787834069.293948:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:2.0:1787834069.293953:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14891:x1874679382005248:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787834069.293962:0:17141:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787834069.293979:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14891:x1874679382005248:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.293984:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00080000:1.0:1787834069.294268:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787834069.294660:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.295637:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382005120 00000100:00100000:2.0:1787834069.295648:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382005120 00000100:00100000:2.0:1787834069.295729:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:2.0:1787834069.295739:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:0:x1874679382005120:12345-192.168.203.17@tcp:41:mount.lustre.0 00000100:00080000:1.0:1787834069.296174:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787834069.296458:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000004:00000024:2.0:1787834069.299080:0:17141:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834069.299389:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:0:x1874679382005120:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 3646us (5843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.299398:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:2.0:1787834069.299428:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382005376 00000100:00100000:2.0:1787834069.299433:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382005376 00000100:00100000:2.0:1787834069.299467:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:2.0:1787834069.299476:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14891:x1874679382005376:12345-192.168.203.17@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787834069.299522:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14891:x1874679382005376:12345-192.168.203.17@tcp:40:mount.lustre.0 Request processed in 49us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.299528:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1787834069.304713:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834069.304890:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382005760 00000100:00100000:1.0:1787834069.304899:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382005760 00000100:00100000:1.0:1787834069.304962:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:1.0:1787834069.304983:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14891:x1874679382005760:12345-192.168.203.17@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787834069.305077:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14891:x1874679382005760:12345-192.168.203.17@tcp:900:mount.lustre.0 Request processed in 96us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834069.305085:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:0.0:1787834069.310235:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834069.310292:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834069.310458:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382005504 00000100:00100000:3.0:1787834069.310467:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382005504 00000100:00100000:3.0:1787834069.310522:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382005632 00000100:00100000:3.0:1787834069.310525:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382005632 00000100:00100000:3.0:1787834069.310547:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:3.0:1787834069.310554:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1874679382005504:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787834069.310589:0:18650:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 4903173d-3c15-42de-bfe8-e4a9090d66c7@192.168.203.17@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:3.0:1787834069.310618:0:18650:0:(genops.c:1385:class_connect()) connect: client 4903173d-3c15-42de-bfe8-e4a9090d66c7, cookie 0x996d2fb20dc1e936 00002000:00100000:3.0:1787834069.310629:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4903173d-3c15-42de-bfe8-e4a9090d66c7/ffff8df50441d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787834069.310647:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787834069.310842:0:18650:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787834069.310872:0:18650:0:(import.c:65:import_set_state_nolock()) ffff8df50441b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834069.310939:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2397:x1874679382005504:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 384us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834069.310947:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:3.0:1787834069.310965:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:3.0:1787834069.310970:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1874679382005632:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787834069.310986:0:18650:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 4903173d-3c15-42de-bfe8-e4a9090d66c7@192.168.203.17@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:3.0:1787834069.311070:0:18650:0:(genops.c:1385:class_connect()) connect: client 4903173d-3c15-42de-bfe8-e4a9090d66c7, cookie 0x996d2fb20dc1e93d 00002000:00100000:3.0:1787834069.311078:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4903173d-3c15-42de-bfe8-e4a9090d66c7/ffff8df50441e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787834069.311089:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787834069.311299:0:18650:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787834069.311317:0:18650:0:(import.c:65:import_set_state_nolock()) ffff8df50441f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834069.311343:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2397:x1874679382005632:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 371us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834069.311350:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:0.0:1787834069.315854:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.315968:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382005888 00000100:00100000:2.0:1787834069.315978:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382005888 00000100:00100000:2.0:1787834069.316041:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:2.0:1787834069.316059:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14891:x1874679382005888:12345-192.168.203.17@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787834069.320928:0:17144:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4619us 00000004:00200000:1.0:1787834069.336803:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787834069.336933:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14891:x1874679382005888:12345-192.168.203.17@tcp:33:mount.lustre.0 Request processed in 20878us (21083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834069.336947:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1787834069.492309:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834069.496685:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382006016 00000100:00100000:2.0:1787834069.496700:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382006016 00000100:00100000:2.0:1787834069.496789:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:2.0:1787834069.496799:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14938:x1874679382006016:12345-192.168.203.17@tcp:101:mkdir.0 00010000:00010000:2.0:1787834069.496820:0:18167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834069.496846:0:18167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1e944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91efa5 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.496910:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1e94b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.496923:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1e94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.496937:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1e94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834069.496982:0:18167:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787834069.496986:0:18167:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834069.497227:0:18167:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1e94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.497271:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1e944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efa5 expref: 8 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.497291:0:18167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1e94b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efa5 expref: 7 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834069.497300:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802400) 00010000:00010000:2.0:1787834069.497302:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787834069.497306:0:18167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f200, rc 0) 00000100:00100000:2.0:1787834069.497364:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:14938:x1874679382006016:12345-192.168.203.17@tcp:101:mkdir.0 Request processed in 566us (5065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834069.497372:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00010000:00010000:1.0:1787834069.785198:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834070.809930:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834071.384675:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787834071.384718:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406205312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787834071.384841:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.385066:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406205312 00000100:00100000:3.0:1787834071.385074:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406205312 00000100:00100000:3.0:1787834071.385153:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834071.385162:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406205312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787834071.385191:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787834071.385237:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406205312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.385245:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787834071.385363:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787834071.385442:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406205312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787834071.615466:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834071.615600:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382006144 00000100:00100000:1.0:1787834071.615609:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382006144 00000100:00100000:1.0:1787834071.615686:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:1.0:1787834071.615698:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:14990:x1874679382006144:12345-192.168.203.17@tcp:41:lfs.0 00000004:00000024:1.0:1787834071.615745:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787834071.615871:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:14990:x1874679382006144:12345-192.168.203.17@tcp:41:lfs.0 Request processed in 175us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834071.615884:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00080000:3.0:1787834071.616788:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787834071.619292:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834071.629161:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382006272 00000100:00100000:2.0:1787834071.629176:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382006272 00000100:00100000:2.0:1787834071.629261:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:2.0:1787834071.629271:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14990:x1874679382006272:12345-192.168.203.17@tcp:41:lfs.0 00000004:00000024:2.0:1787834071.629308:0:17141:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834071.629420:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14990:x1874679382006272:12345-192.168.203.17@tcp:41:lfs.0 Request processed in 150us (10137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834071.629428:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00080000:3.0:1787834071.630330:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787834071.632536:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834071.632721:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382006400 00000100:00100000:3.0:1787834071.632730:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382006400 00000100:00100000:3.0:1787834071.632833:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1787834071.632844:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14990:x1874679382006400:12345-192.168.203.17@tcp:13:lfs.0 00002000:00000024:3.0:1787834071.632871:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787834071.632971:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14990:x1874679382006400:12345-192.168.203.17@tcp:13:lfs.0 Request processed in 129us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.632979:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00080000:1.0:1787834071.633326:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787834071.639586:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834071.639821:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382006528 00000100:00100000:3.0:1787834071.639832:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382006528 00000100:00100000:3.0:1787834071.639901:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1787834071.639911:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14990:x1874679382006528:12345-192.168.203.17@tcp:13:lfs.0 00002000:00000024:3.0:1787834071.639941:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787834071.640036:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:14990:x1874679382006528:12345-192.168.203.17@tcp:13:lfs.0 Request processed in 126us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.640044:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00080000:1.0:1787834071.640724:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787834071.830387:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834071.898864:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406205440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834071.898936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834071.899010:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406205440 00000100:00100000:2.0:1787834071.899017:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406205440 00000100:00100000:2.0:1787834071.899073:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787834071.899081:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406205440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787834071.899107:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834071.899165:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406205440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834071.899173:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787834071.899216:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406205440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787834071.899336:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787834071.899345:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406205568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787834071.899373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.899398:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406205568 00000100:00100000:3.0:1787834071.899401:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406205568 00000100:00100000:3.0:1787834071.899433:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787834071.899440:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406205568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787834071.899455:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787834071.899487:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406205568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.899494:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787834071.899523:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406205568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787834071.899887:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406206080:0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.899918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834071.899935:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406206592:0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.899952:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834071.899967:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787834071.899972:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406205952:0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.899992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834071.900005:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406206464:0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.900024:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834071.900040:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406206976:0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.900059:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834071.900083:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406206080 00000100:00100000:0.0:1787834071.900086:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406206080 00000100:00100000:0.0:1787834071.900107:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406206592 00000100:00100000:0.0:1787834071.900110:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406206592 00000100:00100000:0.0:1787834071.900123:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406206464 00000100:00100000:0.0:1787834071.900126:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406206464 00000100:00100000:0.0:1787834071.900149:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406206976 00000100:00100000:0.0:1787834071.900152:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406206976 00000100:00100000:0.0:1787834071.900167:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787834071.900174:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406206080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.900211:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406206080:12345-0@lo:400:kworker.0 Request processed in 38us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834071.900227:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787834071.900241:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787834071.900246:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406206592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.900274:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6213383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406206592:12345-0@lo:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834071.900279:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787834071.900289:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787834071.900294:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504572940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406206464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.900317:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504572940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406206464:12345-0@lo:400:kworker.0 Request processed in 23us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834071.900323:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787834071.900332:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787834071.900337:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406206976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.900356:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406206976:12345-0@lo:400:kworker.0 Request processed in 20us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834071.900361:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787834071.900387:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406206464:0@lo:400:kworker.0 00010000:00080000:0.0:1787834071.900397:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df621339a40 x1874679406206976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834071.900407:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406206976:0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.900414:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406206080:0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.900421:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406206592:0@lo:400:kworker.0 00000100:00100000:1.0:1787834071.900827:0:19277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406205952 00000100:00100000:1.0:1787834071.900831:0:19277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406205952 00000100:00100000:1.0:1787834071.900862:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787834071.900869:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406205952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834071.900908:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406205952:12345-0@lo:400:kworker.0 Request processed in 40us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834071.900922:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787834071.900940:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787834071.900944:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787834071.900946:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787834071.900948:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787834071.900953:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787834071.900961:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406207104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787834071.900987:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.901065:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406205824:0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.901098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.901134:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406206336:0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.901168:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.901182:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406206848:0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.901206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.901224:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787834071.901230:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406205696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834071.901250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.901271:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406206208:0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.901288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.901301:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df62133a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406206720:0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.901317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.901329:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406207232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787834071.901348:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834071.901372:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406205696 00000100:00100000:3.0:1787834071.901376:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406205696 00000100:00100000:3.0:1787834071.901395:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406206208 00000100:00100000:3.0:1787834071.901397:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406206208 00000100:00100000:3.0:1787834071.901408:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787834071.901414:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874679406205696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787834071.901444:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787834071.901489:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874679406205696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.901495:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787834071.901508:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787834071.901513:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406206208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.901538:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406206208:12345-0@lo:400:kworker.0 Request processed in 26us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.901544:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787834071.901562:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406207104 00000100:00100000:3.0:1787834071.901575:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406207104 00000100:00100000:3.0:1787834071.901594:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406207232 00000100:00100000:3.0:1787834071.901597:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406207232 00000100:00100000:3.0:1787834071.901615:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787834071.901621:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406207104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787834071.901639:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787834071.901669:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406207104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.901676:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787834071.901687:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834071.901693:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406207232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787834071.901702:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787834071.901726:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406207232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.901731:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834071.901785:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406206848 00000100:00100000:3.0:1787834071.901790:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406206848 00000100:00100000:3.0:1787834071.901814:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406206720 00000100:00100000:3.0:1787834071.901817:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406206720 00000100:00100000:3.0:1787834071.901832:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787834071.901836:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406206848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.901863:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406206848:12345-0@lo:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.901868:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787834071.901878:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787834071.901883:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406206720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.901906:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406206720:12345-0@lo:400:kworker.0 Request processed in 23us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.901911:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787834071.901948:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406205696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834071.901957:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406206208:0@lo:400:kworker.0 00010000:00080000:3.0:1787834071.901977:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df62133a580 x1874679406206720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834071.901988:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df62133a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406206720:0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.901997:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787834071.902011:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406207232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787834071.902022:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621338b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406206848:0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.902051:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406206336 00000100:00100000:3.0:1787834071.902054:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406206336 00000100:00100000:3.0:1787834071.902074:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787834071.902079:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ec43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406206336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.902109:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ec43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406206336:12345-0@lo:400:kworker.0 Request processed in 29us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.902114:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787834071.902151:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406206336:0@lo:400:kworker.0 00000100:00100000:1.0:1787834071.903819:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406205824 00000100:00100000:1.0:1787834071.903831:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406205824 00000100:00100000:1.0:1787834071.903887:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787834071.903895:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3639:x1874679406205824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834071.903975:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3639:x1874679406205824:12345-0@lo:400:kworker.0 Request processed in 81us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834071.903982:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1787834071.904019:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787834071.904025:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787834071.904028:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787834071.904067:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406207104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787834071.904098:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406205824:0@lo:400:kworker.0 00000100:00100000:0.0:1787834071.905184:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406205952:0@lo:400:kworker.0 00000100:00100000:3.0:1787834071.907551:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834071.912129:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382006656 00000100:00100000:2.0:1787834071.912156:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382006656 00000100:00100000:2.0:1787834071.912234:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 132 00000100:00100000:2.0:1787834071.912245:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+10:15024:x1874679382006656:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787834071.912262:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834071.912279:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1e952 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91efac expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834071.912307:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1e952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efac expref: 11 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834071.912319:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1e952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efac expref: 11 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834071.912328:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4fe00, rc 0) 00000100:00100000:2.0:1787834071.912400:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15024:x1874679382006656:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 157us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834071.912409:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 132 00000100:00100000:2.0:1787834071.922511:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834071.922664:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382006784 00000100:00100000:3.0:1787834071.922674:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382006784 00000100:00100000:3.0:1787834071.922729:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:3.0:1787834071.922740:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15024:x1874679382006784:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787834071.923176:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15024:x1874679382006784:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 436us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834071.923185:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:0.0:1787834071.928358:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834071.928464:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382006912 00000100:00100000:1.0:1787834071.928479:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382006912 00000100:00100000:1.0:1787834071.928539:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:1.0:1787834071.928550:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15024:x1874679382006912:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787834071.928720:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15024:x1874679382006912:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 173us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834071.928737:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:0.0:1787834071.936954:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834071.937609:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382007040 00000100:00100000:1.0:1787834071.937618:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382007040 00000100:00100000:1.0:1787834071.937681:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 135 00000100:00100000:1.0:1787834071.937689:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15029:x1874679382007040:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787834071.938148:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15029:x1874679382007040:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 457us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834071.938157:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 135 00000100:00100000:0.0:1787834071.991512:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834071.991799:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382007168 00000100:00100000:2.0:1787834071.991822:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382007168 00000100:00100000:2.0:1787834071.992301:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:2.0:1787834071.992311:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502515050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15029:x1874679382007168:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787834071.992479:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502515050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15029:x1874679382007168:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 160us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834071.992487:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:0.0:1787834071.999215:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834072.000549:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382007296 00000100:00100000:1.0:1787834072.000561:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382007296 00000100:00100000:1.0:1787834072.000646:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:1.0:1787834072.000656:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15029:x1874679382007296:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787834072.001050:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15029:x1874679382007296:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 393us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834072.001058:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:0.0:1787834072.009302:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834072.010337:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382007424 00000100:00100000:1.0:1787834072.010355:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382007424 00000100:00100000:1.0:1787834072.010425:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:1.0:1787834072.010445:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+11:15024:x1874679382007424:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787834072.010462:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834072.010480:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1e959 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91efdd expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834072.010509:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1e959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efdd expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834072.010546:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1e959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efdd expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834072.010556:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a000, rc 0) 00000100:00100000:1.0:1787834072.010997:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+12:15024:x1874679382007424:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 561us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834072.011004:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:0.0:1787834072.023865:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834072.024677:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382007552 00000100:00100000:2.0:1787834072.024689:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382007552 00000100:00100000:2.0:1787834072.024748:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 139 00000100:00100000:2.0:1787834072.024791:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+12:15024:x1874679382007552:12345-192.168.203.17@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787834072.024815:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787834072.024845:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787834072.024849:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787834072.024852:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787834072.024855:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787834072.024857:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787834072.027958:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+12:15024:x1874679382007552:12345-192.168.203.17@tcp:256:mount.lustre.0 Request processed in 3156us (4091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834072.028887:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 139 00000100:00100000:0.0:1787834072.034320:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834072.040951:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382007680 00000100:00100000:1.0:1787834072.040964:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382007680 00000100:00100000:1.0:1787834072.041244:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 140 00000100:00100000:1.0:1787834072.041255:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+12:15024:x1874679382007680:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787834072.041272:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834072.041290:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91efe4 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834072.041316:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efe4 expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834072.041328:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efe4 expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834072.041337:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3aa00, rc 0) 00000100:00100000:1.0:1787834072.041391:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+13:15024:x1874679382007680:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 138us (7082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834072.041398:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 140 00000100:00100000:0.0:1787834072.058353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834072.058457:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382007808 00000100:00100000:2.0:1787834072.058467:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382007808 00000100:00100000:2.0:1787834072.058525:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:2.0:1787834072.058535:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:15024:x1874679382007808:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787834072.059854:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:15024:x1874679382007808:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 1315us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834072.059866:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:0.0:1787834072.073555:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834072.073795:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382007936 00000100:00100000:3.0:1787834072.073804:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382007936 00000100:00100000:3.0:1787834072.073872:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:3.0:1787834072.073882:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+13:15024:x1874679382007936:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787834072.074040:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+13:15024:x1874679382007936:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 159us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834072.074048:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:0.0:1787834072.079427:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834072.080442:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382008064 00000100:00100000:2.0:1787834072.080465:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382008064 00000100:00100000:2.0:1787834072.080526:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 143 00000100:00100000:2.0:1787834072.080536:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:15035:x1874679382008064:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787834072.080695:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:15035:x1874679382008064:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 159us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834072.080702:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 143 00000100:00100000:0.0:1787834072.089715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834072.089893:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382008192 00000100:00100000:1.0:1787834072.089916:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382008192 00000100:00100000:1.0:1787834072.090396:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 144 00000100:00100000:1.0:1787834072.090408:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+13:15035:x1874679382008192:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787834072.090563:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+13:15035:x1874679382008192:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 157us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834072.090572:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 144 00000100:00100000:0.0:1787834072.109265:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.109306:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.109344:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.109379:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.109413:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382009216 00000100:00100000:0.0:1787834072.109421:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382009216 00000100:00100000:0.0:1787834072.109486:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1787834072.109497:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504571680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2399:x1874679382009216:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834072.109577:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504571680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2399:x1874679382009216:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834072.109585:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1787834072.109637:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.109729:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834072.109779:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382008320 00000100:00100000:3.0:1787834072.109785:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382008320 00000100:00100000:3.0:1787834072.109805:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382008576 00000100:00100000:3.0:1787834072.109808:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382008576 00000100:00100000:0.0:1787834072.109811:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382009344 00000100:00100000:0.0:1787834072.109817:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382009344 00000100:00100000:3.0:1787834072.109818:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382008960 00000100:00100000:3.0:1787834072.109823:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382008960 00000100:00100000:3.0:1787834072.109849:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382009088 00000100:00100000:0.0:1787834072.109849:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1787834072.109853:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382009088 00000100:00100000:3.0:1787834072.109873:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:0.0:1787834072.109875:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2399:x1874679382009344:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834072.109885:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:2399:x1874679382008960:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834072.109918:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2399:x1874679382009344:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 47us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834072.109926:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504572580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:2399:x1874679382008960:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 42us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834072.109931:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1787834072.109939:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:3.0:1787834072.110302:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:3.0:1787834072.110310:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504571e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2399:x1874679382009088:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834072.110372:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504571e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2399:x1874679382009088:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 62us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834072.110379:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:3.0:1787834072.110395:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:3.0:1787834072.110400:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504573c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1874679382008320:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787834072.110424:0:17142:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 3b7b3847-f4f2-42ea-93f4-1f34e9067bef@192.168.203.17@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1787834072.110479:0:17142:0:(genops.c:1385:class_connect()) connect: client 3b7b3847-f4f2-42ea-93f4-1f34e9067bef, cookie 0x996d2fb20dc1e967 00000004:00100000:3.0:1787834072.110508:0:17142:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787834072.110528:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1787834072.110536:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504571a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1874679382008576:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787834072.110566:0:17141:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 3b7b3847-f4f2-42ea-93f4-1f34e9067bef@192.168.203.17@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1787834072.110600:0:17141:0:(genops.c:1385:class_connect()) connect: client 3b7b3847-f4f2-42ea-93f4-1f34e9067bef, cookie 0x996d2fb20dc1e96e 00000100:00080000:3.0:1787834072.110601:0:17142:0:(import.c:65:import_set_state_nolock()) ffff8df504418000 : changing import state from RECOVER to FULL 00000004:00100000:1.0:1787834072.110615:0:17141:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787834072.110635:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504573c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2397:x1874679382008320:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 233us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834072.110643:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00080000:1.0:1787834072.110823:0:17141:0:(import.c:65:import_set_state_nolock()) ffff8df5039ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834072.110853:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504571a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2397:x1874679382008576:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 316us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834072.110861:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:0.0:1787834072.123816:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.123860:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.123884:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834072.123981:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382008832 00000100:00100000:3.0:1787834072.123991:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382008832 00000100:00100000:3.0:1787834072.124054:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382008704 00000100:00100000:3.0:1787834072.124057:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382008704 00000100:00100000:3.0:1787834072.124074:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382008448 00000100:00100000:3.0:1787834072.124076:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382008448 00000100:00100000:3.0:1787834072.124090:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1787834072.124109:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+7:15024:x1874679382008832:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787834072.124160:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787834072.124221:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+7:15024:x1874679382008832:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 122us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834072.124229:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1787834072.124246:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:3.0:1787834072.124252:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:0:x1874679382008704:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787834072.124267:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787834072.124293:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:0:x1874679382008704:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 42us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834072.124299:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:3.0:1787834072.124312:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1787834072.124318:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504572d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:0:x1874679382008448:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787834072.124343:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787834072.124364:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504572d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:0:x1874679382008448:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 47us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834072.124370:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00080000:0.0:1787834072.124531:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787834072.124536:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787834072.130589:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834072.131066:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382009472 00000100:00100000:3.0:1787834072.131075:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382009472 00000100:00100000:3.0:1787834072.131151:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:3.0:1787834072.131160:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:15024:x1874679382009472:12345-192.168.203.17@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787834072.131248:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:15024:x1874679382009472:12345-192.168.203.17@tcp:40:mount.lustre.0 Request processed in 90us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834072.131255:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787834072.139275:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.139316:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.139351:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834072.139443:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382009856 00000100:00100000:1.0:1787834072.139452:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382009856 00000100:00100000:1.0:1787834072.139524:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:1.0:1787834072.139534:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:15024:x1874679382009856:12345-192.168.203.17@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787834072.139607:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:15024:x1874679382009856:12345-192.168.203.17@tcp:900:mount.lustre.0 Request processed in 75us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834072.139615:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1787834072.145817:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382009600 00000100:00100000:3.0:1787834072.145833:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382009600 00000100:00100000:1.0:1787834072.146117:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382009728 00000100:00100000:1.0:1787834072.146121:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382009728 00000100:00100000:1.0:1787834072.146164:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:1.0:1787834072.146187:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1874679382009600:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787834072.146225:0:19578:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 3b7b3847-f4f2-42ea-93f4-1f34e9067bef@192.168.203.17@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1787834072.146258:0:19578:0:(genops.c:1385:class_connect()) connect: client 3b7b3847-f4f2-42ea-93f4-1f34e9067bef, cookie 0x996d2fb20dc1e975 00002000:00100000:1.0:1787834072.146270:0:19578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3b7b3847-f4f2-42ea-93f4-1f34e9067bef/ffff8df5039ef800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787834072.146283:0:19578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787834072.146373:0:19578:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787834072.146407:0:19578:0:(import.c:65:import_set_state_nolock()) ffff8df5039ec800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834072.146499:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2397:x1874679382009600:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 312us (7181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834072.146508:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:1.0:1787834072.146531:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:1.0:1787834072.146536:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1874679382009728:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787834072.146553:0:19578:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 3b7b3847-f4f2-42ea-93f4-1f34e9067bef@192.168.203.17@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1787834072.146570:0:19578:0:(genops.c:1385:class_connect()) connect: client 3b7b3847-f4f2-42ea-93f4-1f34e9067bef, cookie 0x996d2fb20dc1e97c 00002000:00100000:1.0:1787834072.146575:0:19578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3b7b3847-f4f2-42ea-93f4-1f34e9067bef/ffff8df5039e9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787834072.146581:0:19578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787834072.146620:0:19578:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787834072.146649:0:19578:0:(import.c:65:import_set_state_nolock()) ffff8df502ccf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834072.146673:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2397:x1874679382009728:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 135us (7321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834072.146680:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:1.0:1787834072.146742:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834072.147316:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382009984 00000100:00100000:0.0:1787834072.147323:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382009984 00000100:00100000:0.0:1787834072.147368:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:0.0:1787834072.147377:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:15024:x1874679382009984:12345-192.168.203.17@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787834072.147453:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787834072.147525:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:15024:x1874679382009984:12345-192.168.203.17@tcp:33:mount.lustre.0 Request processed in 150us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834072.147533:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:1.0:1787834072.350909:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834072.351516:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382010112 00000100:00100000:2.0:1787834072.351528:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382010112 00000100:00100000:2.0:1787834072.351595:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:2.0:1787834072.351605:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:15058:x1874679382010112:12345-192.168.203.17@tcp:101:mkdir.0 00010000:00010000:2.0:1787834072.351625:0:18167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834072.351645:0:18167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1e983 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f015 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834072.351710:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834072.351724:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834072.351737:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834072.351812:0:18167:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787834072.351816:0:18167:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834072.351834:0:18167:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834072.351871:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1e983 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f015 expref: 8 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834072.351903:0:18167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f015 expref: 7 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834072.351912:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802400) 00010000:00010000:2.0:1787834072.351916:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787834072.351919:0:18167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e800, rc 0) 00000100:00100000:2.0:1787834072.351972:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+7:15058:x1874679382010112:12345-192.168.203.17@tcp:101:mkdir.0 Request processed in 369us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834072.351979:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00010000:00010000:1.0:1787834072.854056:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787834073.048580:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787834073.879364:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834074.902036:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787834074.976323:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000001:00100000:2.0:1787834074.976337:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4903173d-3c15-42de-bfe8-e4a9090d66c7 00000001:00100000:1.0:1787834074.978499:0:17121:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000001:00100000:1.0:1787834074.978511:0:17121:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4903173d-3c15-42de-bfe8-e4a9090d66c7 00000001:00100000:1.0:1787834074.979867:0:17874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000001:00100000:1.0:1787834074.979878:0:17874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4903173d-3c15-42de-bfe8-e4a9090d66c7 00000001:00100000:0.0:1787834074.986744:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000001:00100000:0.0:1787834074.986781:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4903173d-3c15-42de-bfe8-e4a9090d66c7 00000001:02000400:3.0:1787834075.212289:0:20021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787834075.925973:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834076.502925:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787834076.502949:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406207360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787834076.503029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834076.503095:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406207360 00000100:00100000:1.0:1787834076.503113:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406207360 00000100:00100000:1.0:1787834076.503167:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787834076.503177:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406207360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787834076.503206:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787834076.503252:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406207360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834076.503259:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787834076.503281:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787834076.503317:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406207360:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787834076.949834:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834077.014335:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787834077.014360:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406207488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834077.014429:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834077.014491:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406207488 00000100:00100000:2.0:1787834077.014497:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406207488 00000100:00100000:2.0:1787834077.014550:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787834077.014559:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406207488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787834077.014590:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834077.014633:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406207488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834077.014641:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787834077.014684:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406207488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787834077.015655:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406207744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787834077.015698:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.015742:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406207744 00000100:00100000:3.0:1787834077.015747:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406207744 00000100:00100000:3.0:1787834077.015808:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787834077.015816:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406207744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787834077.016042:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787834077.016088:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406207744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 273us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.016109:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787834077.016130:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787834077.016175:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406207744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787834077.016262:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406207616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834077.016293:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.016323:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406207616 00000100:00100000:3.0:1787834077.016327:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406207616 00000100:00100000:3.0:1787834077.016367:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787834077.016374:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406207616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787834077.016396:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787834077.016433:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406207616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.016440:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787834077.016470:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406207616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834077.017148:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406207872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787834077.017182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.017214:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406207872 00000100:00100000:3.0:1787834077.017218:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406207872 00000100:00100000:3.0:1787834077.017246:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787834077.017252:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406207872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787834077.017264:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787834077.017296:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406207872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.017303:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787834077.017320:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787834077.017340:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406207872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787834077.017416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406208000:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.017452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.017474:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406208512:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.017639:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.017664:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787834077.017670:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406208128:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.017695:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.017713:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406208640:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.017735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.017781:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406208000 00000100:00100000:3.0:1787834077.017785:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406208000 00000100:00100000:3.0:1787834077.017814:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787834077.017821:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3640:x1874679406208000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.017935:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3640:x1874679406208000:12345-0@lo:400:kworker.0 Request processed in 114us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.017942:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787834077.017970:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406208512 00000100:00100000:3.0:1787834077.017974:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406208512 00000100:00100000:3.0:1787834077.018003:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406208640 00000100:00100000:3.0:1787834077.018005:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406208640 00000100:00100000:3.0:1787834077.018024:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787834077.018032:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406208512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018063:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406208512:12345-0@lo:400:kworker.0 Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.018069:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787834077.018081:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787834077.018086:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406208640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018190:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406208640:12345-0@lo:400:kworker.0 Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.018197:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787834077.018216:0:19277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406208128 00000100:00100000:3.0:1787834077.018219:0:19277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406208128 00000100:00100000:3.0:1787834077.018247:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787834077.018254:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406208128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018283:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406208128:12345-0@lo:400:kworker.0 Request processed in 30us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.018289:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787834077.018303:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787834077.018307:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787834077.018309:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787834077.018319:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406208256:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.018359:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406208768:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.018394:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787834077.018400:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406208384:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.018427:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406208896:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018452:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834077.018474:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406208256 00000100:00100000:3.0:1787834077.018477:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406208256 00000100:00100000:3.0:1787834077.018493:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406208768 00000100:00100000:3.0:1787834077.018495:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406208768 00000100:00100000:3.0:1787834077.018511:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406208384 00000100:00100000:3.0:1787834077.018620:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406208384 00000100:00100000:3.0:1787834077.018640:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406208896 00000100:00100000:3.0:1787834077.018643:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406208896 00000100:00100000:3.0:1787834077.018658:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787834077.018663:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406208256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018699:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406208256:12345-0@lo:400:kworker.0 Request processed in 35us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.018705:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787834077.018719:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787834077.018726:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406208768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018776:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406208768:12345-0@lo:400:kworker.0 Request processed in 50us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.018782:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787834077.018798:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787834077.018804:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406208384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018829:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406208384:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.018835:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787834077.018945:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787834077.018952:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406208896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.018981:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406208896:12345-0@lo:400:kworker.0 Request processed in 30us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834077.018987:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787834077.019003:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787834077.019005:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787834077.019028:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406208384:0@lo:400:kworker.0 00010000:00080000:3.0:1787834077.019052:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6012e8f00 x1874679406208896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834077.019063:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406208896:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.019073:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406208256:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.019080:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406208768:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.019204:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406208128:0@lo:400:kworker.0 00010000:00080000:3.0:1787834077.019217:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6012e8b40 x1874679406208640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834077.019226:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406208640:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.019235:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406208000:0@lo:400:kworker.0 00000100:00100000:3.0:1787834077.019247:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406208512:0@lo:400:kworker.0 00000100:00100000:1.0:1787834077.019588:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787834077.019598:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406209024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787834077.019634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834077.019668:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406209024 00000100:00100000:1.0:1787834077.019672:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406209024 00000100:00100000:1.0:1787834077.019703:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787834077.019708:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406209024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787834077.019724:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787834077.019790:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406209024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834077.019796:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787834077.019829:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406209024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787834077.238954:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834077.238998:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834077.239047:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834077.239073:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834077.239107:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834077.239129:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834077.239150:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834077.239168:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834077.239194:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834077.239219:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382010240 00000100:00100000:0.0:1787834077.239219:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382010496 00000100:00100000:0.0:1787834077.239228:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382010496 00000100:00100000:2.0:1787834077.239229:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382010240 00000100:00100000:0.0:1787834077.239267:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382011008 00000100:00100000:0.0:1787834077.239270:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382011008 00000100:00100000:2.0:1787834077.239274:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:0.0:1787834077.239281:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382010368 00000100:00100000:2.0:1787834077.239282:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2399:x1874679382010240:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834077.239283:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382010368 00000100:00100000:0.0:1787834077.239295:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382010880 00000100:00100000:0.0:1787834077.239297:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382010880 00000100:00100000:0.0:1787834077.239308:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:0.0:1787834077.239313:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504570f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2399:x1874679382010496:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834077.239348:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504570f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2399:x1874679382010496:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834077.239349:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2399:x1874679382010240:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 67us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834077.239356:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:0.0:1787834077.239356:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:0.0:1787834077.239370:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:0.0:1787834077.239376:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2399:x1874679382011008:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834077.239397:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2399:x1874679382011008:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 21us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834077.239403:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:0.0:1787834077.239413:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:0.0:1787834077.239418:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621339a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2399:x1874679382010368:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834077.239447:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621339a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2399:x1874679382010368:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834077.239453:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:0.0:1787834077.239464:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:0.0:1787834077.239470:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2399:x1874679382010880:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834077.239491:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2399:x1874679382010880:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 22us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834077.239497:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:0.0:1787834077.239514:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382010752 00000100:00100000:0.0:1787834077.239517:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382010752 00000100:00100000:0.0:1787834077.239554:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382011264 00000100:00100000:0.0:1787834077.239732:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382011264 00000100:00100000:0.0:1787834077.239780:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382010624 00000100:00100000:0.0:1787834077.239783:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382010624 00000100:00100000:0.0:1787834077.239797:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382011136 00000100:00100000:0.0:1787834077.239799:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382011136 00000100:00100000:0.0:1787834077.239812:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1787834077.239818:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621338b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2399:x1874679382010752:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834077.239921:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621338b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2399:x1874679382010752:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 102us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834077.239928:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1787834077.239941:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:0.0:1787834077.239947:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2399:x1874679382011264:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834077.239970:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2399:x1874679382011264:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834077.239987:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:0.0:1787834077.239999:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1787834077.240005:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2399:x1874679382010624:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834077.240031:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2399:x1874679382010624:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834077.240036:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1787834077.240047:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:0.0:1787834077.240052:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621292580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2399:x1874679382011136:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834077.240073:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621292580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2399:x1874679382011136:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 21us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834077.240078:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00080000:1.0:1787834077.240408:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787834077.240413:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787834077.240415:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787834077.240417:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787834077.973888:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787834078.794484:0:20168:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe18cf3860 20000000:00000080:2.0:1787834078.794503:0:20168:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df63a8a7400 uarg=0000000000000000 20000000:01000000:2.0:1787834078.794546:0:20168:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787834078.795884:0:20168:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787834078.795890:0:20168:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787834078.797303:0:20169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787834078.798883:0:20168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787834078.813525:0:20168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787834078.813586:0:20168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.813605:0:20168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e61f expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.813614:0:20168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e62d expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.813621:0:20168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e66c expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.813628:0:20168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e706 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.813652:0:20168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef74 expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.813660:0:20168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efe4 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.813668:0:20168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.813710:0:20168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efe4 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.813724:0:20168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efe4 expref: 12 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834078.813738:0:20168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209152:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787834078.814208:0:20168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef74 expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.814218:0:20168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef74 expref: 12 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834078.814226:0:20168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209280:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787834078.814324:0:20168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e706 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.814333:0:20168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e706 expref: 23 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834078.814342:0:20168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a45e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209408:0@lo:104: 00000100:00100000:1.0:1787834078.814384:0:20168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834078.815405:0:20168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e66c expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.815418:0:20168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e66c expref: 23 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834078.815427:0:20168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a46580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209536:0@lo:104: 00000100:00100000:1.0:1787834078.815470:0:20168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834078.819878:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834078.819923:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834078.819959:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382011392 00000100:00100000:3.0:1787834078.819967:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382011392 00010000:00010000:3.0:1787834078.820005:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efe4 expref: 13 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834078.820036:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382011520 00000100:00100000:3.0:1787834078.820039:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382011520 00010000:00010000:3.0:1787834078.820052:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef74 expref: 14 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834078.820111:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1787834078.820119:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8abb39-d835-4001-b54a-d8ba07846eed+14:2401:x1874679382011392:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787834078.820134:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834078.820140:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efe4 expref: 14 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.820152:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efe4 expref: 14 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.820171:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834078.820224:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8abb39-d835-4001-b54a-d8ba07846eed+14:2401:x1874679382011392:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 106us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834078.820230:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1787834078.820264:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1787834078.820271:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2401:x1874679382011520:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787834078.820278:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834078.820282:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef74 expref: 13 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.820298:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef74 expref: 13 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.820307:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834078.820325:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2401:x1874679382011520:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 55us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834078.820331:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:2.0:1787834078.821448:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406209408 00000100:00100000:2.0:1787834078.821456:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406209408 00010000:00010000:1.0:1787834078.821459:0:20168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e62d expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.821475:0:20168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e62d expref: 23 pid: 17136 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834078.821489:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406209536 00000100:00100000:1.0:1787834078.821490:0:20168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209664:0@lo:104: 00000100:00100000:2.0:1787834078.821495:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406209536 00000100:00100000:2.0:1787834078.821512:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787834078.821520:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a44780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:20168:x1874679406209408:12345-0@lo:104: 00010000:00010000:2.0:1787834078.821532:0:17124:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834078.821541:0:20168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834078.821568:0:20168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1e61f expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.821578:0:20168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1e61f expref: 23 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834078.821587:0:20168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ff03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209792:0@lo:104: 00010000:00010000:2.0:1787834078.821600:0:17124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787834078.821607:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a44780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:20168:x1874679406209408:12345-0@lo:104: Request processed in 89us (7223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834078.821614:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787834078.821632:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406209664 00000100:00100000:1.0:1787834078.821632:0:20168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834078.821638:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406209664 00000100:00100000:2.0:1787834078.821651:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406209792 00000100:00100000:1.0:1787834078.821653:0:20168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef16cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834078.821654:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406209792 00010000:00010000:1.0:1787834078.821678:0:20168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3aa00/0x996d2fb20dc1e960 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efe4 expref: 12 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834078.821680:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787834078.821697:0:20168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209152:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787834078.821709:0:20168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676000/0x996d2fb20dc1e921 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef74 expref: 11 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834078.821718:0:20168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209280:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787834078.821727:0:20168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a45e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209408:0@lo:104: 00000100:00100000:2.0:1787834078.822155:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+5:20168:x1874679406209536:12345-0@lo:104: 00010000:00010000:2.0:1787834078.822164:0:17124:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834078.822647:0:17124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787834078.822656:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+5:20168:x1874679406209536:12345-0@lo:104: Request processed in 967us (7185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834078.822663:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787834078.822691:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787834078.822699:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:20168:x1874679406209664:12345-0@lo:104: 00010000:00010000:2.0:1787834078.822708:0:17124:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.822786:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787834078.822794:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.822802:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccc200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787834078.822806:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.822815:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787834078.822823:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834078.822829:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787834078.822860:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.822868:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787834078.822886:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.822893:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504ccc200/0x996d2fb20dc1e706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e70d expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.822904:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834078.822907:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.822912:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccde00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787834078.822915:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.822931:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.822934:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834078.822942:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.822953:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccca00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834078.822959:0:19480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787834078.822960:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834078.822977:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787834078.822978:0:19480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834078.822987:0:19480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.822996:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834078.823004:0:19480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787834078.823006:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787834078.823019:0:20168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a46580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209536:0@lo:104: 00010000:00010000:3.0:1787834078.823024:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.823028:0:19480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.823042:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504ccde00/0x996d2fb20dc1e66c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e673 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.823043:0:19480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787834078.823044:0:20168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209664:0@lo:104: 00010000:00010000:0.0:1787834078.823053:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.823062:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504ccca00/0x996d2fb20dc1e62d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e634 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.823068:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834078.823072:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834078.823074:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834078.823075:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834078.823079:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834078.823083:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834078.823108:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406209920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834078.823142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834078.823198:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406209920 00000100:00100000:0.0:1787834078.823205:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406209920 00010000:00010000:1.0:1787834078.823501:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e706 expref: 24 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834078.823557:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787834078.823566:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3641:x1874679406209920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834078.823576:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834078.823581:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e706 expref: 24 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.823592:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e706 expref: 24 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.823606:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df620722400/0x996d2fb20dc1e70d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e706 expref: 24 pid: 17135 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834078.823617:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834078.823654:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:3641:x1874679406209920:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834078.823661:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787834078.823859:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406210048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834078.823899:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787834078.825544:0:17124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787834078.825558:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+4:20168:x1874679406209664:12345-0@lo:104: Request processed in 2857us (4017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834078.825570:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787834078.825601:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787834078.825614:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504775e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:20168:x1874679406209792:12345-0@lo:104: 00010000:00010000:2.0:1787834078.825628:0:17124:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834078.826163:0:17124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787834078.826170:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504775e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+3:20168:x1874679406209792:12345-0@lo:104: Request processed in 562us (4540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834078.826177:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787834078.828357:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406210048 00000100:00100000:1.0:1787834078.828375:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406210048 00010000:00010000:1.0:1787834078.828428:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e66c expref: 23 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834078.828447:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406209920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787834078.828474:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787834078.828484:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:3638:x1874679406210048:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834078.828491:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406210176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834078.828500:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834078.828506:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e66c expref: 23 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.828520:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e66c expref: 23 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.828539:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504677000/0x996d2fb20dc1e673 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e66c expref: 23 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834078.828552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834078.828557:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834078.828601:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:3638:x1874679406210048:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (4700us total) trans 0 rc 0/0 00010000:00010000:3.0:1787834078.828604:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787834078.828611:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787834078.828612:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834078.828627:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406210176 00000100:00100000:1.0:1787834078.828633:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406210176 00010000:00010000:3.0:1787834078.828635:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787834078.828641:0:17129:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.828647:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e62d expref: 22 pid: 17136 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.828652:0:17129:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787834078.828661:0:17129:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834078.828678:0:17129:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787834078.828689:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787834078.828721:0:17129:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.828728:0:17129:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787834078.828741:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.828748:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1e61f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1e626 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.828778:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834078.828780:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834078.828782:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834078.828797:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834078.828802:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787834078.828810:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406210304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834078.828835:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834078.828859:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406210304 00000100:00100000:3.0:1787834078.828868:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406210304 00010000:00010000:3.0:1787834078.828884:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e61f expref: 23 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834078.828899:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834078.828906:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:3641:x1874679406210304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834078.828913:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834078.828918:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e61f expref: 23 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.828927:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e61f expref: 23 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834078.828937:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834078.829019:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635d75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:3639:x1874679406210176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834078.829030:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834078.829036:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1e62d expref: 23 pid: 17136 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829045:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1e62d expref: 23 pid: 17136 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829056:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031a00/0x996d2fb20dc1e634 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e62d expref: 23 pid: 17136 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829069:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829077:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829102:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829110:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829117:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829123:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834078.829242:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:3641:x1874679406210304:12345-0@lo:103:ldlm_bl.0 Request processed in 335us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834078.829249:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834078.829277:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406210304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834078.829357:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834078.829361:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829369:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829379:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829389:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834078.829428:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635d75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:3639:x1874679406210176:12345-0@lo:103:ldlm_bl.0 Request processed in 731us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834078.829436:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787834078.829484:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406210176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834078.829520:0:20168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676c00/0x996d2fb20dc1e626 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1e61f expref: 20 pid: 17133 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834078.829532:0:20168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ff03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20168:1874679406209792:0@lo:104: 00010000:00010000:1.0:1787834078.829558:0:20168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829567:0:20168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829573:0:20168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834078.829579:0:20168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676200/0x996d2fb20dc1e991 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834078.829843:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406210048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834079.000448:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787834079.515029:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787834080.023201:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787834080.283777:0:17138:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787834080.283784:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63a82c000 from 13 10000000:01000000:0.0:1787834080.283789:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787834080.283832:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834080.283843:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834080.283854:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834080.283878:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787834080.283950:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834080.283998:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef16e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787834080.284555:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406210432 00000100:00100000:3.0:1787834080.284563:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406210432 00000100:00100000:3.0:1787834080.284618:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787834080.284627:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:17138:x1874679406210432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834080.284649:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834080.284672:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b7600/0x996d2fb20dc1e99f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e998 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.284696:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7600/0x996d2fb20dc1e99f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e998 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.284719:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b7600/0x996d2fb20dc1e99f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e998 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.284729:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7600, rc 0) 00000100:00100000:3.0:1787834080.284800:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:17138:x1874679406210432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834080.284807:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787834080.285473:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834080.285492:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834080.285501:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834080.285571:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834080.285605:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834080.285647:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef16e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787834080.286089:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406210560 00000100:00100000:3.0:1787834080.286096:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406210560 00000100:00100000:3.0:1787834080.286136:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787834080.286144:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:17138:x1874679406210560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834080.286267:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:17138:x1874679406210560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834080.286275:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787834080.286374:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834080.286402:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787834080.286443:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834080.286471:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef16e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787834080.286516:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406210688 00000100:00100000:1.0:1787834080.286520:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406210688 00000100:00100000:1.0:1787834080.286551:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787834080.286559:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:17138:x1874679406210688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.286647:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:17138:x1874679406210688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.286654:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787834080.286869:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787834080.287814:0:20237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787834080.288066:0:17138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787834080.288095:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787834080.288104:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.288114:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834080.288124:0:17138:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787834080.288126:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df63435b800 from 13 10000000:01000000:1.0:1787834080.288129:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787834080.288157:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.288165:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.288174:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834080.288191:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.288245:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834080.288271:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a6bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787834080.288285:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406210816 00000100:00100000:1.0:1787834080.288290:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406210816 00000100:00100000:1.0:1787834080.288318:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787834080.288326:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:17138:x1874679406210816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834080.288336:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834080.288346:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1e9ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e9a6 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.288366:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1e9ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e9a6 expref: 22 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.288375:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1e9ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e9a6 expref: 22 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.288383:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ae00, rc 0) 00000100:00100000:1.0:1787834080.288414:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:17138:x1874679406210816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.288420:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787834080.288455:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834080.288466:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.288475:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834080.288516:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.288545:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834080.288557:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a6bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787834080.288568:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406210944 00000100:00100000:1.0:1787834080.288571:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406210944 00000100:00100000:1.0:1787834080.288590:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787834080.288595:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:17138:x1874679406210944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.289883:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:17138:x1874679406210944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1283us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.289894:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787834080.290051:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406210944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.290101:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.290147:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834080.290175:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605a6bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787834080.290190:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406211072 00000100:00100000:1.0:1787834080.290194:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406211072 00000100:00100000:1.0:1787834080.290223:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787834080.290229:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:17138:x1874679406211072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.290307:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:17138:x1874679406211072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.290314:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787834080.290349:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787834080.292255:0:20238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787834080.292422:0:17138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787834080.292445:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787834080.292456:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.292468:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834080.292477:0:17138:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787834080.292480:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df611643000 from 13 10000000:01000000:3.0:1787834080.292483:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787834080.292515:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.292533:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.292543:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834080.292563:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787834080.292617:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834080.292657:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df611df8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787834080.296879:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406211200 00000100:00100000:1.0:1787834080.296896:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406211200 00000100:00100000:1.0:1787834080.296968:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787834080.296991:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:17138:x1874679406211200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834080.297007:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834080.297025:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1e9bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e9b4 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.297053:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1e9bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e9b4 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.297065:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1e9bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e9b4 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.297074:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ba00, rc 0) 00000100:00100000:1.0:1787834080.297171:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502e1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406211200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (4553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.297179:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787834080.297265:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834080.297283:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834080.297292:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834080.297364:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787834080.297396:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834080.297432:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834080.297556:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406211328 00000100:00100000:3.0:1787834080.297560:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406211328 00000100:00100000:3.0:1787834080.297594:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787834080.297602:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406211328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834080.297716:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406211328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834080.297723:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787834080.297890:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787834080.297919:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787834080.297958:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834080.297973:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834080.297984:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406211456 00000100:00100000:2.0:1787834080.297987:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406211456 00000100:00100000:2.0:1787834080.298005:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787834080.298011:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406211456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787834080.298095:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406211456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834080.298102:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787834080.298139:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787834080.299142:0:20239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787834080.299410:0:17138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787834080.299428:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787834080.299437:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.299447:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834080.299457:0:17138:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787834080.299460:0:17138:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df504d9f000 from 13 10000000:01000000:3.0:1787834080.299462:0:17138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787834080.299497:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.299505:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.299514:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834080.299530:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787834080.299575:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834080.299609:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6059836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834080.300876:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406211584 00000100:00100000:2.0:1787834080.300887:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406211584 00000100:00100000:2.0:1787834080.301028:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787834080.301046:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:17138:x1874679406211584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834080.301061:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834080.301075:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1e9c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1e9c2 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834080.301111:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1e9c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1e9c2 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834080.301121:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1e9c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1e9c2 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834080.301129:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f600, rc 0) 00000100:00100000:2.0:1787834080.301184:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:17138:x1874679406211584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834080.301191:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787834080.301322:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834080.301338:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834080.301346:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834080.301406:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834080.301437:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834080.306324:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6059836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834080.306370:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406211712 00000100:00100000:1.0:1787834080.306378:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406211712 00000100:00100000:1.0:1787834080.306427:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787834080.306437:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:17138:x1874679406211712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.306626:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:17138:x1874679406211712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (5188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.306634:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787834080.306988:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834080.307040:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787834080.308911:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834080.308979:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6059836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834080.309012:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406211840 00000100:00100000:1.0:1787834080.309019:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406211840 00000100:00100000:1.0:1787834080.309143:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787834080.309153:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:17138:x1874679406211840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.309270:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:17138:x1874679406211840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.309285:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787834080.309362:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:17138:1874679406211840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787834080.310350:0:20240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787834080.311069:0:17138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787834080.311102:0:17138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787834080.311113:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834080.311124:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834080.761475:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834080.762488:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382011648 00000100:00100000:1.0:1787834080.762500:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382011648 00000100:00100000:1.0:1787834080.762596:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00100000:1.0:1787834080.762607:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+11:14905:x1874679382011648:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834080.762626:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834080.762654:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b200/0x996d2fb20dc1e9d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f01c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.762684:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b200/0x996d2fb20dc1e9d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f01c expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.762695:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b200/0x996d2fb20dc1e9d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f01c expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.762704:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b200, rc 0) 00000100:00100000:1.0:1787834080.763021:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+12:14905:x1874679382011648:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 414us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.763029:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00100000:3.0:1787834080.764953:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834080.765113:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382011776 00000100:00100000:1.0:1787834080.765122:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382011776 00000100:00100000:1.0:1787834080.765213:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 160 00000100:00100000:1.0:1787834080.765222:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+12:14905:x1874679382011776:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787834080.765379:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+12:14905:x1874679382011776:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 158us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.765387:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 160 00000100:00100000:1.0:1787834080.768974:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834080.769114:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382011904 00000100:00100000:2.0:1787834080.769124:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382011904 00000100:00100000:2.0:1787834080.769183:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 161 00000100:00100000:2.0:1787834080.769194:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+12:14905:x1874679382011904:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787834080.770387:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+12:14905:x1874679382011904:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 1189us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834080.770398:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 161 00000100:00100000:3.0:1787834080.789183:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834080.789310:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382012032 00000100:00100000:1.0:1787834080.789319:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382012032 00000100:00100000:1.0:1787834080.789380:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 162 00000100:00100000:1.0:1787834080.789391:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+12:14905:x1874679382012032:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834080.789407:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834080.789424:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1e9d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f023 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.789457:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1e9d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f023 expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.789469:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1e9d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f023 expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834080.789478:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b800, rc 0) 00000100:00100000:1.0:1787834080.789546:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+13:14905:x1874679382012032:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 157us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834080.789553:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 162 00000100:00100000:3.0:1787834080.791335:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834080.791419:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382012160 00000100:00100000:2.0:1787834080.791427:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382012160 00000100:00100000:2.0:1787834080.791474:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 163 00000100:00100000:2.0:1787834080.791483:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+13:14905:x1874679382012160:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787834080.791631:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+13:14905:x1874679382012160:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 148us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834080.791638:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 163 00000100:00100000:2.0:1787834080.796623:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834080.797475:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382012288 00000100:00100000:3.0:1787834080.797486:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382012288 00000100:00100000:3.0:1787834080.797552:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 164 00000100:00100000:3.0:1787834080.797563:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:14905:x1874679382012288:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787834080.797702:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:14905:x1874679382012288:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 140us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834080.797710:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 164 00010000:00010000:2.0:1787834081.048002:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834081.622491:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787834081.622519:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406211968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787834081.622602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834081.622728:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406211968 00000100:00100000:1.0:1787834081.622736:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406211968 00000100:00100000:1.0:1787834081.622841:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787834081.622853:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406211968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787834081.622891:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787834081.622947:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406211968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834081.622954:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787834081.623003:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406211968:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787834081.623499:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787834082.071251:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834082.134272:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406212224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787834082.134350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834082.134393:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787834082.134400:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406212096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787834082.134427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834082.134507:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406212224 00000100:00100000:3.0:1787834082.134514:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406212224 00000100:00100000:2.0:1787834082.134658:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406212096 00000100:00100000:2.0:1787834082.134663:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406212096 00000100:00100000:2.0:1787834082.134712:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787834082.134722:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406212096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787834082.134746:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834082.134819:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406212096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.134827:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787834082.134851:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787834082.134863:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406212352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834082.134889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834082.134908:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787834082.134926:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406212480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787834082.134948:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834082.134970:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406212480 00000100:00100000:2.0:1787834082.134974:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406212480 00000100:00100000:2.0:1787834082.134998:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787834082.135004:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406212480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787834082.135022:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787834082.135051:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406212480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.135085:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787834082.135102:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787834082.135134:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406212480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787834082.135178:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504774b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406212096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787834082.135189:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787834082.135195:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406212608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787834082.135219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834082.135240:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406212608 00000100:00100000:2.0:1787834082.135243:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406212608 00000100:00100000:2.0:1787834082.135266:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787834082.135273:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406212608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787834082.135282:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787834082.135311:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406212608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.135317:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787834082.135331:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787834082.135348:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406212608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787834082.135378:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406212352 00000100:00100000:2.0:1787834082.135381:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406212352 00000100:00100000:2.0:1787834082.135402:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787834082.135408:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406212352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787834082.135434:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787834082.135469:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406212352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.135473:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787834082.135509:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406212352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787834082.135875:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504774f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406212992:0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.136032:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406212736:0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.136076:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834082.136103:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406213248:0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.136127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834082.136147:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787834082.136153:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504775a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406213120:0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.136173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834082.136191:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406213632:0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.136210:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834082.136235:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406213248 00000100:00100000:2.0:1787834082.136239:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406213248 00000100:00100000:2.0:1787834082.136272:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406213120 00000100:00100000:2.0:1787834082.136275:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406213120 00000100:00100000:2.0:1787834082.136287:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406213632 00000100:00100000:2.0:1787834082.136289:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406213632 00000100:00100000:2.0:1787834082.136303:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787834082.136309:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406213248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.136350:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406213248:12345-0@lo:400:kworker.0 Request processed in 41us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.136357:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787834082.136369:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787834082.136374:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406213120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.136401:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406213120:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.136407:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787834082.136430:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787834082.136436:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406213632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.136480:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406213632:12345-0@lo:400:kworker.0 Request processed in 43us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.136486:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787834082.136503:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787834082.136507:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787834082.136603:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834082.136627:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406213504:0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.136652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834082.136671:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787834082.136676:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406212864:0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.136696:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834082.136706:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504776580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406213376:0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.136725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834082.136746:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406213504 00000100:00100000:1.0:1787834082.136771:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406213504 00000100:00100000:1.0:1787834082.136870:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406212864 00000100:00100000:1.0:1787834082.136873:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406212864 00000100:00100000:1.0:1787834082.136884:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406213376 00000100:00100000:1.0:1787834082.136886:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406213376 00000100:00100000:1.0:1787834082.136901:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787834082.136907:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406213504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.137017:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406213504:12345-0@lo:400:kworker.0 Request processed in 109us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.137023:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787834082.137036:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787834082.137042:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406212864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.137080:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406212864:12345-0@lo:400:kworker.0 Request processed in 39us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.137086:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787834082.137098:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787834082.137111:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406213376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.137139:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406213376:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.137144:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787834082.137170:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406212992 00000100:00100000:1.0:1787834082.137174:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406212992 00000100:00100000:1.0:1787834082.137200:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787834082.137206:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406212992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.137238:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406212992:12345-0@lo:400:kworker.0 Request processed in 32us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.137244:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787834082.137263:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787834082.137266:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787834082.137291:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406212864:0@lo:400:kworker.0 00010000:00080000:1.0:1787834082.137304:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504776580 x1874679406213376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834082.137314:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504776580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406213376:0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.137324:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504774f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406212992:0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.137333:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406213504:0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.137384:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406212736 00000100:00100000:1.0:1787834082.137388:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406212736 00000100:00100000:1.0:1787834082.137418:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787834082.137425:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3639:x1874679406212736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834082.137457:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3639:x1874679406212736:12345-0@lo:400:kworker.0 Request processed in 33us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.137474:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787834082.138182:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787834082.138190:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406212224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787834082.138220:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787834082.138265:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406212224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (3916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834082.138271:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787834082.139634:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504775a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406213120:0@lo:400:kworker.0 00010000:00080000:2.0:1787834082.139680:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504777c00 x1874679406213632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834082.139693:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406213632:0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.139703:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406212736:0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.139716:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406213248:0@lo:400:kworker.0 00000100:00100000:2.0:1787834082.139735:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406212224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834082.361797:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.361840:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.361871:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.361889:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834082.362135:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382012416 00000100:00100000:2.0:1787834082.362146:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382012416 00000100:00100000:2.0:1787834082.362197:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 166 00000100:00100000:2.0:1787834082.362206:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2401:x1874679382012416:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834082.362277:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2401:x1874679382012416:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 72us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.362285:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 166 00000100:00100000:0.0:1787834082.362963:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.362980:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.363005:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.363021:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.363038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.363058:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382012928 00000100:00100000:0.0:1787834082.363074:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382012928 00000100:00100000:0.0:1787834082.363109:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382013440 00000100:00100000:0.0:1787834082.363111:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382013440 00000100:00100000:0.0:1787834082.363121:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382012800 00000100:00100000:0.0:1787834082.363123:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382012800 00000100:00100000:0.0:1787834082.363132:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382013312 00000100:00100000:0.0:1787834082.363134:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382013312 00000100:00100000:0.0:1787834082.363146:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1787834082.363152:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2401:x1874679382012928:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834082.363189:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2401:x1874679382012928:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.363196:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1787834082.363207:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:0.0:1787834082.363212:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2401:x1874679382013440:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834082.363229:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2401:x1874679382013440:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 18us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.363235:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:0.0:1787834082.363243:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:0.0:1787834082.363248:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2401:x1874679382012800:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834082.363264:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2401:x1874679382012800:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 16us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.363279:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:0.0:1787834082.363289:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:0.0:1787834082.363294:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2401:x1874679382013312:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834082.363314:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2401:x1874679382013312:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 20us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.363319:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:0.0:1787834082.363332:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382012672 00000100:00100000:0.0:1787834082.363335:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382012672 00000100:00100000:0.0:1787834082.363354:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382013184 00000100:00100000:0.0:1787834082.363356:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382013184 00000100:00100000:0.0:1787834082.363365:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382012544 00000100:00100000:0.0:1787834082.363367:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382012544 00000100:00100000:0.0:1787834082.363375:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382013056 00000100:00100000:0.0:1787834082.363377:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382013056 00000100:00100000:0.0:1787834082.363387:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:0.0:1787834082.363392:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2401:x1874679382012672:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834082.363413:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2401:x1874679382012672:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 21us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.363419:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:0.0:1787834082.363427:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:0.0:1787834082.363432:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2401:x1874679382013184:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834082.363448:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2401:x1874679382013184:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 16us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.363453:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:0.0:1787834082.363461:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:0.0:1787834082.363471:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2401:x1874679382012544:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834082.363490:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2401:x1874679382012544:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 19us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.363495:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:0.0:1787834082.363504:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:0.0:1787834082.363509:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2401:x1874679382013056:12345-192.168.203.17@tcp:400:kworker.0 00000100:00080000:1.0:1787834082.363743:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787834082.363747:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787834082.363782:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787834082.363784:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787834082.364030:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2401:x1874679382013056:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 15us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.364039:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:2.0:1787834082.382012:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.382247:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382013568 00000100:00100000:1.0:1787834082.382256:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382013568 00000100:00100000:1.0:1787834082.382319:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:1.0:1787834082.382329:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:15574:x1874679382013568:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787834082.382349:0:18167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834082.382370:0:18167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1e9de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f02a expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.382434:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.382448:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.382461:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.382474:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.382480:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.382486:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.382667:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1e9f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.382676:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1e9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.382684:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1e9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787834082.382711:0:18167:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787834082.382715:0:18167:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787834082.383131:0:18167:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1e9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383145:0:18167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383152:0:18167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383158:0:18167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383163:0:18167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3be00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834082.383167:0:18167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383175:0:18167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383187:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802400) 00010000:00010000:1.0:1787834082.383198:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834082.383203:0:18167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383210:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1e9e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383223:0:18167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383229:0:18167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383233:0:18167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383238:0:18167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834082.383240:0:18167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383246:0:18167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383253:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8df503f0c700) 00010000:00010000:1.0:1787834082.383255:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834082.383258:0:18167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383263:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1e9ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383297:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1e9de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f02a expref: 8 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383322:0:18167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1e9f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f02a expref: 7 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.383329:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df503f0c900) 00010000:00010000:1.0:1787834082.383332:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787834082.383334:0:18167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a200, rc 0) 00000100:00100000:1.0:1787834082.383402:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:15574:x1874679382013568:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1074us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.383410:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:2.0:1787834082.387302:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.389027:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382013696 00000100:00100000:1.0:1787834082.389039:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382013696 00000100:00100000:1.0:1787834082.389115:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:1.0:1787834082.389128:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:15574:x1874679382013696:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787834082.389222:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:15574:x1874679382013696:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 Request processed in 96us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.389230:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1787834082.392371:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834082.392455:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382013952 00000100:00100000:3.0:1787834082.392464:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382013952 00000100:00100000:3.0:1787834082.392520:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787834082.392544:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:15574:x1874679382013952:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787834082.392565:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834082.392586:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1e9fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f031 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.392659:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.392674:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.392686:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.392726:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.392734:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.392741:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.392875:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1ea0f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.392885:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1ea0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.392892:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1ea0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834082.392913:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787834082.393056:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393074:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393080:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393086:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834082.393090:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393097:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393110:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df503f0c900) 00010000:00010000:3.0:1787834082.393113:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834082.393118:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393123:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393135:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393141:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393155:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393160:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834082.393163:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393169:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393177:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df502e11f00) 00010000:00010000:3.0:1787834082.393179:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834082.393182:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.393187:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea08 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.398689:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1e9fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f031 expref: 10 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.398716:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1ea0f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f031 expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.398725:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df502e11800) 00010000:00010000:3.0:1787834082.398728:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834082.398733:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7000, rc 0) 00000100:00100000:3.0:1787834082.398834:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+9:15574:x1874679382013952:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 6291us (6471us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787834082.398860:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787834082.403210:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.403918:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382014080 00000100:00100000:1.0:1787834082.403928:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382014080 00000100:00100000:1.0:1787834082.403993:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:1.0:1787834082.404004:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+9:15574:x1874679382014080:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787834082.404113:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+9:15574:x1874679382014080:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 110us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.404121:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:0.0:1787834082.406138:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834082.406236:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382014208 00000100:00100000:2.0:1787834082.406256:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382014208 00000100:00100000:2.0:1787834082.406310:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:2.0:1787834082.406320:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:15574:x1874679382014208:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1787834082.407908:0:17143:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1548us 00000100:00100000:1.0:1787834082.442110:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:15574:x1874679382014208:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 35780us (35968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.442125:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:0.0:1787834082.461353:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834082.461442:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382014336 00000100:00100000:2.0:1787834082.461453:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382014336 00000100:00100000:2.0:1787834082.461522:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1787834082.461533:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+9:15580:x1874679382014336:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787834082.461553:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834082.461576:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1ea1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f038 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461653:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461668:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461679:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461695:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461701:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461709:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461795:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461816:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461823:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461829:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834082.461833:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461840:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461853:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802400) 00010000:00010000:2.0:1787834082.461856:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834082.461861:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461867:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ea24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461879:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461885:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461891:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461896:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ec00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834082.461906:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461925:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461934:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df6068e6d00) 00010000:00010000:2.0:1787834082.461937:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834082.461940:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461946:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1ea2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461980:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1ea1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f038 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.461992:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802400) 00010000:00010000:2.0:1787834082.461994:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834082.461998:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1ea1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f038 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.462007:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4fa00, rc 0) 00000100:00100000:2.0:1787834082.462079:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+9:15580:x1874679382014336:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 549us (736us total) trans 0 rc 301/301 00000100:00100000:2.0:1787834082.462087:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1787834082.470696:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.470818:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382014464 00000100:00100000:1.0:1787834082.470828:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382014464 00000100:00100000:1.0:1787834082.470879:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1787834082.470889:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4903173d-3c15-42de-bfe8-e4a9090d66c7+9:15580:x1874679382014464:12345-192.168.203.17@tcp:700:lfs.0 00000100:00100000:1.0:1787834082.471124:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4903173d-3c15-42de-bfe8-e4a9090d66c7+9:15580:x1874679382014464:12345-192.168.203.17@tcp:700:lfs.0 Request processed in 235us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.471132:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:0.0:1787834082.473665:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834082.473867:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382014720 00000100:00100000:3.0:1787834082.473877:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382014720 00000100:00100000:3.0:1787834082.473934:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:3.0:1787834082.473944:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+9:15580:x1874679382014720:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:3.0:1787834082.473999:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834082.474025:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1e94b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efa5 expref: 9 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.474045:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802400) 00010000:00010000:3.0:1787834082.474050:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787834082.474128:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.474143:0:17142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f015 expref: 5 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.474152:0:17142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.474185:0:17142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f015 expref: 5 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.474198:0:17142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f015 expref: 5 pid: 18167 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834082.474212:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17142:1874679406213760:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787834082.474314:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605983b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787834082.481299:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.481406:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382014848 00000100:00100000:1.0:1787834082.481416:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382014848 00010000:00010000:1.0:1787834082.481457:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f015 expref: 6 pid: 18167 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834082.481498:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:1.0:1787834082.481508:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2400:x1874679382014848:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834082.481524:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834082.481530:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f015 expref: 6 pid: 18167 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.481543:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f015 expref: 6 pid: 18167 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.481564:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802400) 00010000:00010000:1.0:1787834082.481570:0:17127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.481591:0:17127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.481599:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.481620:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834082.481697:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2400:x1874679382014848:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 190us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.481705:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00010000:00010000:3.0:1787834082.482342:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1e98a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f015 expref: 5 pid: 18167 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834082.482370:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17142:1874679406213760:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787834082.482393:0:17142:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.482403:0:17142:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.482408:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.482433:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.482443:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.482451:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485207:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485227:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485238:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787834082.485267:0:17142:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f542bacc reply state 0000000028804634 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485279:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485287:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:3.0:1787834082.485291:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787834082.485295:0:17142:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787834082.485301:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787834082.485309:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485316:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485323:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485329:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834082.485334:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485341:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485351:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802400) 00010000:00010000:3.0:1787834082.485354:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834082.485357:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485372:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1ea32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787834082.485391:0:17142:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f542bacc reply state 0000000028804634 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485400:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.485406:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df502e11f00) 00010000:00010000:3.0:1787834082.485409:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787834082.485411:0:17142:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787834082.485554:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+10:15580:x1874679382014720:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 11608us (11893us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787834082.485563:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:0.0:1787834082.556858:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834082.556960:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382014976 00000100:00100000:2.0:1787834082.556970:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382014976 00000100:00100000:2.0:1787834082.557032:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:2.0:1787834082.557070:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+10:15588:x1874679382014976:12345-192.168.203.17@tcp:101:lctl.0 00010000:00010000:2.0:1787834082.557094:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834082.557117:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1ea47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f03f expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.557185:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f000/0x996d2fb20dc1ea4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.557198:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f000/0x996d2fb20dc1ea4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.557209:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f000/0x996d2fb20dc1ea4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834082.557251:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787834082.557255:0:17141:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834082.557291:0:17141:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f000/0x996d2fb20dc1ea4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.557316:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1ea47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f03f expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.557333:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f000/0x996d2fb20dc1ea4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f03f expref: 11 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.557341:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:2.0:1787834082.557343:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787834082.557347:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f000, rc 0) 00000100:00100000:2.0:1787834082.557409:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+11:15588:x1874679382014976:12345-192.168.203.17@tcp:101:lctl.0 Request processed in 355us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.557426:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 29 00000040:00080000:3.0:1787834082.582471:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787834082.593841:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.594019:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382015104 00000100:00100000:1.0:1787834082.594029:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382015104 00000100:00100000:1.0:1787834082.594501:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:1.0:1787834082.594514:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:15589:x1874679382015104:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787834082.594536:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834082.594559:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ea55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f046 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.594634:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1ea5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.594663:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1ea5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.594675:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1ea5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787834082.594716:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787834082.594720:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787834082.594774:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1ea5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.594799:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ea55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f046 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.594816:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1ea5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f046 expref: 6 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.594825:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:1.0:1787834082.594828:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787834082.594831:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b600, rc 0) 00000100:00100000:1.0:1787834082.594890:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:15589:x1874679382015104:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 380us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.594897:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:0.0:1787834082.599906:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834082.600126:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382015232 00000100:00100000:2.0:1787834082.600135:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382015232 00000100:00100000:2.0:1787834082.600220:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:2.0:1787834082.600231:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:15589:x1874679382015232:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787834082.600262:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834082.600283:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1ea63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f04d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600524:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600540:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600551:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600561:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600567:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600574:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600859:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ea78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600882:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ea78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600890:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ea78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834082.600939:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787834082.600943:0:17141:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834082.600964:0:17141:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ea78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600975:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600982:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600987:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.600994:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834082.600998:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601006:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601018:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:2.0:1787834082.601021:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834082.601026:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601041:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f400/0x996d2fb20dc1ea6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601173:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601181:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601187:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601192:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834082.601195:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601200:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601208:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df502e11f00) 00010000:00010000:2.0:1787834082.601211:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834082.601213:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601218:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ea71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601466:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1ea63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f04d expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601494:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ea78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f04d expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.601501:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:2.0:1787834082.601503:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787834082.601506:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e600, rc 0) 00000100:00100000:2.0:1787834082.601579:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+7:15589:x1874679382015232:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1349us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.601587:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:3.0:1787834082.607405:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834082.607523:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382015360 00000100:00100000:2.0:1787834082.607532:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382015360 00000100:00100000:2.0:1787834082.607581:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:2.0:1787834082.607591:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:15589:x1874679382015360:12345-192.168.203.17@tcp:900:lfs.0 00000100:00100000:2.0:1787834082.607680:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:15589:x1874679382015360:12345-192.168.203.17@tcp:900:lfs.0 Request processed in 91us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.607687:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1787834082.612353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.612555:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382015616 00000100:00100000:1.0:1787834082.612564:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382015616 00000100:00100000:1.0:1787834082.612627:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:1.0:1787834082.612645:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+7:15589:x1874679382015616:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787834082.612666:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834082.612688:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ea7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f054 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787834082.613171:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787834082.613291:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ea7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f054 expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.613306:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:0.0:1787834082.613309:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787834082.613314:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ea7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f054 expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.613329:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a400, rc 0) 00000100:00100000:0.0:1787834082.613416:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+8:15589:x1874679382015616:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 781us (1083us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787834082.613424:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:2.0:1787834082.619427:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.619516:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382015872 00000100:00100000:1.0:1787834082.619526:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382015872 00000100:00100000:1.0:1787834082.619590:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:1.0:1787834082.619600:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+8:15589:x1874679382015872:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:1.0:1787834082.619957:0:18167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834082.619998:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ea78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f04d expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.620017:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:1.0:1787834082.620021:0:18167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787834082.623027:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.623051:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.623072:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787834082.623277:0:18167:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a9fea0c reply state 0000000055f54411 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.623290:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.623297:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:0.0:1787834082.623300:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787834082.623304:0:18167:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787834082.623311:0:18167:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787834082.623475:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+9:15589:x1874679382015872:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 3873us (4053us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787834082.623484:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:3.0:1787834082.626051:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.626360:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382016128 00000100:00100000:1.0:1787834082.626369:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382016128 00000100:00100000:1.0:1787834082.626429:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:1.0:1787834082.626438:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+9:15589:x1874679382016128:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787834082.626921:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+10:15589:x1874679382016128:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 481us (876us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787834082.626930:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:3.0:1787834082.629677:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.629820:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382016384 00000100:00100000:0.0:1787834082.629829:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382016384 00000100:00100000:0.0:1787834082.629889:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:0.0:1787834082.629900:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+10:15589:x1874679382016384:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787834082.629928:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834082.629958:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1ea94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f05b expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630024:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630037:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630048:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630075:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630082:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630089:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787834082.630187:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787834082.630260:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630268:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630274:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630280:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787834082.630284:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630297:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630309:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:0.0:1787834082.630312:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787834082.630316:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630322:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1ea9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630337:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630343:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630350:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630354:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787834082.630357:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630363:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630369:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df502e11f00) 00010000:00010000:0.0:1787834082.630371:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787834082.630373:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630387:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eaa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630416:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1ea94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f05b expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630425:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:0.0:1787834082.630428:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787834082.630431:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1ea94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f05b expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.630439:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676c00, rc 0) 00000100:00100000:0.0:1787834082.630495:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+11:15589:x1874679382016384:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 598us (827us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787834082.630503:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:2.0:1787834082.634008:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.634278:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382016512 00000100:00100000:1.0:1787834082.634287:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382016512 00000100:00100000:1.0:1787834082.634350:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:1.0:1787834082.634360:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+11:15589:x1874679382016512:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787834082.634384:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834082.634405:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eab0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f062 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.634491:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.634506:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.634519:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787834082.634561:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787834082.634564:0:17141:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787834082.634581:0:17141:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.634606:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eab0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f062 expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.634623:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f062 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.634631:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:1.0:1787834082.634635:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787834082.634857:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ac00, rc 0) 00000100:00100000:1.0:1787834082.634970:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+12:15589:x1874679382016512:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 611us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.634978:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:3.0:1787834082.639312:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.639552:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382016640 00000100:00100000:0.0:1787834082.639561:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382016640 00000100:00100000:0.0:1787834082.639606:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:0.0:1787834082.639614:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+12:15589:x1874679382016640:12345-192.168.203.17@tcp:37:lfs.0 00000100:00100000:0.0:1787834082.645197:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+12:15589:x1874679382016640:12345-192.168.203.17@tcp:37:lfs.0 Request processed in 5571us (5882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.645210:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1787834082.651939:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834082.652177:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382016896 00000100:00100000:3.0:1787834082.652186:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382016896 00000100:00100000:3.0:1787834082.652230:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1787834082.652247:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df606df5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+12:15589:x1874679382016896:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1787834082.652441:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df606df5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+13:15589:x1874679382016896:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 203us (509us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787834082.652463:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1787834082.725881:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.725925:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382017024 00000100:00100000:0.0:1787834082.725935:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382017024 00000100:00100000:0.0:1787834082.725996:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:0.0:1787834082.726006:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+11:15595:x1874679382017024:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1787834082.726051:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834082.726080:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1eabe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f069 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726146:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726162:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726174:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726184:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726192:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726198:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726281:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1ead3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726293:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1ead3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726299:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1ead3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787834082.726331:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787834082.726449:0:17142:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787834082.726491:0:17142:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1ead3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726504:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726510:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726516:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726522:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787834082.726526:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726533:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726546:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:0.0:1787834082.726549:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787834082.726555:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726560:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726573:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726578:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726595:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726599:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787834082.726602:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726609:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726617:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df502e11f00) 00010000:00010000:0.0:1787834082.726620:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787834082.726623:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.726629:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eacc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.731008:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1eabe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f069 expref: 13 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.731435:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1ead3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f069 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.731447:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:0.0:1787834082.731450:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787834082.731454:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677200, rc 0) 00000100:00100000:0.0:1787834082.731538:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+12:15595:x1874679382017024:12345-192.168.203.17@tcp:101:bash.0 Request processed in 5532us (5666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.731565:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:2.0:1787834082.738538:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834082.738644:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382017152 00000100:00100000:3.0:1787834082.738655:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382017152 00000100:00100000:3.0:1787834082.738712:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:3.0:1787834082.738724:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:15595:x1874679382017152:12345-192.168.203.17@tcp:900:bash.0 00000100:00100000:3.0:1787834082.738839:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:15595:x1874679382017152:12345-192.168.203.17@tcp:900:bash.0 Request processed in 117us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834082.738846:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:2.0:1787834082.745006:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834082.745341:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382017408 00000100:00100000:3.0:1787834082.745350:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382017408 00000100:00100000:3.0:1787834082.745412:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:3.0:1787834082.745423:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+12:15595:x1874679382017408:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787834082.745443:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834082.745465:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eada lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f070 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.745561:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.745577:0:17141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f062 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.745585:0:17141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.745616:0:17141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f062 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834082.745657:0:17141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f062 expref: 12 pid: 17141 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834082.745672:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17141:1874679406213888:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787834082.748794:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605983840 going to sleep for 11 seconds 00000100:00100000:1.0:1787834082.749222:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.749276:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382017536 00000100:00100000:0.0:1787834082.749285:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382017536 00010000:00010000:0.0:1787834082.749326:0:18674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f062 expref: 13 pid: 17141 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834082.749372:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:0.0:1787834082.749383:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504775680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+13:2401:x1874679382017536:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834082.749397:0:18674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834082.749403:0:18674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f062 expref: 13 pid: 17141 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.749416:0:18674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f062 expref: 13 pid: 17141 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.749441:0:18674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:0.0:1787834082.749446:0:18674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.749456:0:18674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.749463:0:18674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.749483:0:18674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834082.749540:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504775680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+13:2401:x1874679382017536:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 159us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834082.749564:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00010000:00010000:3.0:1787834082.754294:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1eab7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f062 expref: 12 pid: 17141 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834082.754323:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17141:1874679406213888:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787834082.754357:0:17141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.754559:0:17141:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.754568:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.754613:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.754640:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.754658:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755180:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755190:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755198:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834082.755209:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787834082.755234:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755242:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755249:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755255:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834082.755259:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755276:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755289:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:2.0:1787834082.755292:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834082.755297:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755303:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eae1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787834082.755315:0:17141:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f74c0511 reply state 0000000093ddc277 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755324:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755330:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8df6068e6800) 00010000:00010000:2.0:1787834082.755332:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787834082.755335:0:17141:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787834082.755371:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eada lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f070 expref: 15 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755387:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f070 expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.755394:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834082.755396:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787834082.755399:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e200, rc 0) 00000100:00100000:2.0:1787834082.755472:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+15:15595:x1874679382017408:12345-192.168.203.17@tcp:101:bash.0 Request processed in 10050us (10479us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787834082.755480:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:1.0:1787834082.783081:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834082.783697:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382017664 00000100:00100000:2.0:1787834082.783711:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382017664 00000100:00100000:2.0:1787834082.783843:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:2.0:1787834082.783855:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+15:15595:x1874679382017664:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1787834082.783881:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834082.783905:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1eafd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f077 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.784203:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.784218:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.784229:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834082.784277:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787834082.784282:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834082.784300:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.784312:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.784338:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1eafd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f077 expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.784382:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f077 expref: 16 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834082.784390:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834082.784393:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787834082.784396:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:2.0:1787834082.784463:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+16:15595:x1874679382017664:12345-192.168.203.17@tcp:101:bash.0 Request processed in 611us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834082.784471:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:3.0:1787834082.789322:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.790370:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382017920 00000100:00100000:1.0:1787834082.790383:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382017920 00000100:00100000:1.0:1787834082.790440:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:1.0:1787834082.790449:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+16:15595:x1874679382017920:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:1.0:1787834082.791553:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+17:15595:x1874679382017920:12345-192.168.203.17@tcp:35:bash.0 Request processed in 1098us (2233us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787834082.791563:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1787834082.867624:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.867736:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382018176 00000100:00100000:1.0:1787834082.867747:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382018176 00000100:00100000:1.0:1787834082.867856:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:1.0:1787834082.867867:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+17:15605:x1874679382018176:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787834082.867892:0:18167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834082.867912:0:18167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f07e expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787834082.868145:0:18167:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787834082.868367:0:18167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f07e expref: 19 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.868382:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:1.0:1787834082.868385:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787834082.868390:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f07e expref: 19 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.868404:0:18167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3be00, rc 0) 00000100:00100000:1.0:1787834082.869321:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+18:15605:x1874679382018176:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1451us (1702us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787834082.869332:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:3.0:1787834082.884425:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.884732:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382018432 00000100:00100000:0.0:1787834082.884743:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382018432 00000100:00100000:0.0:1787834082.884839:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:0.0:1787834082.884849:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+18:15605:x1874679382018432:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1787834082.885630:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+19:15605:x1874679382018432:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 777us (1210us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787834082.886081:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:2.0:1787834082.931850:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834082.931955:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382018688 00000100:00100000:0.0:1787834082.931964:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382018688 00000100:00100000:0.0:1787834082.932033:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:0.0:1787834082.932044:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+19:15608:x1874679382018688:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787834082.932078:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834082.932100:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f085 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.932215:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eb20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.932229:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eb20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.932461:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eb20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787834082.932476:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787834082.932586:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb19 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f085 expref: 22 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.932606:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eb20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f085 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834082.932614:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:0.0:1787834082.932617:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787834082.932620:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677e00, rc 0) 00000100:00100000:0.0:1787834082.932880:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+21:15608:x1874679382018688:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 837us (1037us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787834082.932888:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:0.0:1787834082.935889:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.935978:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382018816 00000100:00100000:1.0:1787834082.935989:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382018816 00000100:00100000:1.0:1787834082.936069:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:1.0:1787834082.936080:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+21:15608:x1874679382018816:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1787834082.936151:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.936179:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.936191:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.936222:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.936228:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.936246:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.936253:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3be00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834082.936258:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.936266:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.936277:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:1.0:1787834082.936280:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787834082.936285:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.936291:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834082.936366:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+21:15608:x1874679382018816:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 287us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.936381:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:3.0:1787834082.937216:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.937370:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382018944 00000100:00100000:1.0:1787834082.937377:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382018944 00000100:00100000:1.0:1787834082.937428:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1787834082.937436:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+21:2399:x1874679382018944:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834082.937450:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834082.937469:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1eb20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f085 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834082.937484:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:1.0:1787834082.937489:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834082.937522:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+20:2399:x1874679382018944:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 88us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834082.937530:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1787834082.938981:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834082.939272:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382019200 00000100:00100000:1.0:1787834082.939280:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382019200 00000100:00100000:1.0:1787834082.939330:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:1.0:1787834082.939339:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+20:15608:x1874679382019200:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787834082.939548:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+21:15608:x1874679382019200:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 210us (573us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787834082.939556:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00010000:00010000:0.0:1787834083.093941:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834083.259576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.259689:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382019456 00000100:00100000:2.0:1787834083.259698:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382019456 00000100:00100000:2.0:1787834083.259963:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:2.0:1787834083.259975:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+21:15639:x1874679382019456:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:2.0:1787834083.259999:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834083.260018:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eb35 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f08c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.260418:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1eb3c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.260433:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1eb3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.260445:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1eb3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834083.260475:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787834083.260594:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eb35 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f08c expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.260612:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1eb3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f08c expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.260619:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834083.260622:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787834083.260626:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4ec00, rc 0) 00000100:00100000:2.0:1787834083.260691:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+23:15639:x1874679382019456:12345-192.168.203.17@tcp:101:cat.0 Request processed in 718us (1124us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787834083.260698:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:0.0:1787834083.266150:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834083.266233:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382019712 00000100:00100000:1.0:1787834083.266243:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382019712 00000100:00100000:1.0:1787834083.266294:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:1.0:1787834083.266304:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a978780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+23:15639:x1874679382019712:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:1.0:1787834083.266568:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a978780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+24:15639:x1874679382019712:12345-192.168.203.17@tcp:35:cat.0 Request processed in 265us (427us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787834083.266575:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:3.0:1787834083.269439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.269557:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382019840 00000100:00100000:0.0:1787834083.269566:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382019840 00000100:00100000:0.0:1787834083.269638:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:0.0:1787834083.269649:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+24:2401:x1874679382019840:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834083.269664:0:18674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834083.269689:0:18674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ec00/0x996d2fb20dc1eb3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f08c expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.269709:0:18674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:0.0:1787834083.269714:0:18674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834083.270055:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+23:2401:x1874679382019840:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 407us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834083.270090:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00000040:00080000:0.0:1787834083.286579:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787834083.343445:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834083.344242:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382020096 00000100:00100000:1.0:1787834083.344252:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382020096 00000100:00100000:1.0:1787834083.344318:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:1.0:1787834083.344328:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+23:15645:x1874679382020096:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:1.0:1787834083.344350:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834083.344369:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb4a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f093 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.344474:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.344488:0:17141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f070 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.344497:0:17141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f077 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.344504:0:17141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.344536:0:17141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f077 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.344549:0:17141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f077 expref: 24 pid: 17143 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834083.344583:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504776580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17141:1874679406214016:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787834083.344689:0:17141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f070 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.344698:0:17141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f070 expref: 24 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834083.344706:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047743c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17141:1874679406214144:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787834083.344734:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834083.347218:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504776580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17141:1874679406214016:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787834083.347234:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047743c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17141:1874679406214144:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787834083.347257:0:17141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834083.348846:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834083.348891:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834083.349118:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382020224 00000100:00100000:1.0:1787834083.349126:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382020224 00010000:00010000:1.0:1787834083.349165:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f077 expref: 25 pid: 17143 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834083.349205:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382020352 00000100:00100000:1.0:1787834083.349209:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382020352 00010000:00010000:1.0:1787834083.349221:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f070 expref: 26 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834083.349240:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1787834083.349261:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+26:2401:x1874679382020224:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834083.349276:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834083.349282:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f077 expref: 26 pid: 17143 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349294:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f077 expref: 26 pid: 17143 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349316:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1eb04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f077 expref: 26 pid: 17143 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349332:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:1.0:1787834083.349336:0:17127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349345:0:17127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349351:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834083.349398:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+25:2401:x1874679382020224:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 138us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834083.349406:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1787834083.349423:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:1.0:1787834083.349429:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635d77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+24:2401:x1874679382020352:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834083.349437:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834083.349442:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f070 expref: 24 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349461:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f070 expref: 24 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349473:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1eaef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f070 expref: 24 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349483:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:1.0:1787834083.349487:0:17127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349495:0:17127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349503:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349525:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834083.349545:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635d77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+23:2401:x1874679382020352:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 116us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834083.349552:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00010000:00010000:1.0:1787834083.349594:0:17141:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349602:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787834083.349619:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787834083.349800:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3be00/0x996d2fb20dc1eb4a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f093 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349827:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f093 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.349833:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:1.0:1787834083.349836:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787834083.349838:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3bc00, rc 0) 00000100:00100000:1.0:1787834083.349861:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+23:15645:x1874679382020096:12345-192.168.203.17@tcp:101:dd.0 Request processed in 5536us (6426us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787834083.349868:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:3.0:1787834083.361278:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.361376:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382020480 00000100:00100000:0.0:1787834083.361386:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382020480 00000100:00100000:0.0:1787834083.361447:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:0.0:1787834083.361458:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+23:15645:x1874679382020480:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:0.0:1787834083.361482:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834083.361502:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f09a expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.361539:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.361552:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.361563:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.361684:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f09a expref: 25 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.361704:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f09a expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.361711:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:0.0:1787834083.361714:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787834083.361717:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676000, rc 0) 00000100:00100000:0.0:1787834083.362289:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+24:15645:x1874679382020480:12345-192.168.203.17@tcp:101:dd.0 Request processed in 831us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834083.362297:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:3.0:1787834083.365167:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.366198:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382020736 00000100:00100000:0.0:1787834083.366209:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382020736 00000100:00100000:0.0:1787834083.366320:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:0.0:1787834083.366332:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+24:15645:x1874679382020736:12345-192.168.203.17@tcp:36:dd.0 00010000:00010000:0.0:1787834083.366548:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.366566:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.366578:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787834083.366633:0:18167:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787834083.366657:0:18167:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6fe09db reply state 0000000021593b5c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.366670:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.366678:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:0.0:1787834083.366681:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787834083.366684:0:18167:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787834083.367856:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+27:15645:x1874679382020736:12345-192.168.203.17@tcp:36:dd.0 Request processed in 1520us (2690us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787834083.367866:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000020:00080000:0.0:1787834083.367872:0:18167:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787834083.370112:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.370206:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382020864 00000100:00100000:2.0:1787834083.370216:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382020864 00000100:00100000:2.0:1787834083.370279:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:2.0:1787834083.370289:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+27:15645:x1874679382020864:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:2.0:1787834083.370314:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834083.370335:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eb74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0a1 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.370393:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eb74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a1 expref: 28 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.370409:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eb74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a1 expref: 28 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.370447:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834083.370450:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787834083.370454:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e000, rc 0) 00000100:00100000:2.0:1787834083.370516:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+28:15645:x1874679382020864:12345-192.168.203.17@tcp:101:dd.0 Request processed in 228us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.370523:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:3.0:1787834083.391847:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834083.392010:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382021120 00000100:00100000:1.0:1787834083.392019:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382021120 00000100:00100000:1.0:1787834083.392093:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:1.0:1787834083.392104:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+28:15645:x1874679382021120:12345-192.168.203.17@tcp:103:dd.0 00010000:00010000:1.0:1787834083.392119:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834083.392145:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eb74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a1 expref: 28 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.392162:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:1.0:1787834083.392167:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834083.392223:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+27:15645:x1874679382021120:12345-192.168.203.17@tcp:103:dd.0 Request processed in 121us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834083.392230:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:1.0:1787834083.399508:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.399629:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382021248 00000100:00100000:2.0:1787834083.399639:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382021248 00000100:00100000:2.0:1787834083.399697:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:2.0:1787834083.399708:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+27:15645:x1874679382021248:12345-192.168.203.17@tcp:58:dd.0 00010000:00010000:2.0:1787834083.399828:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.399846:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.399859:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787834083.400880:0:17141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834083.401567:0:17141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787834083.401704:0:17141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787834083.401828:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+27:15645:x1874679382021248:12345-192.168.203.17@tcp:58:dd.0 Request processed in 2117us (2323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.401838:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:3.0:1787834083.406668:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.406787:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382021376 00000100:00100000:0.0:1787834083.406796:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382021376 00000100:00100000:0.0:1787834083.406852:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:0.0:1787834083.406862:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+27:15645:x1874679382021376:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:0.0:1787834083.406882:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834083.406912:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0a8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.406963:0:17142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.406973:0:17142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a8 expref: 28 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.406991:0:17142:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.407003:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a8 expref: 28 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.407015:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:0.0:1787834083.407018:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787834083.407021:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a8 expref: 28 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.407028:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677400, rc 0) 00000100:00100000:0.0:1787834083.407094:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+28:15645:x1874679382021376:12345-192.168.203.17@tcp:101:dd.0 Request processed in 233us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834083.407102:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00000040:00080000:3.0:1787834083.606709:0:17177:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787834083.606719:0:17177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787834083.606786:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787834083.606796:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787834083.606944:0:17177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212930c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17177:1874679406214272:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787834083.607034:0:17177:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605983540 going to sleep for 11 seconds 00000100:00100000:3.0:1787834083.612634:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.612798:0:17177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212930c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17177:1874679406214272:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787834083.614066:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382021504 00000100:00100000:1.0:1787834083.614076:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382021504 00000100:00100000:1.0:1787834083.614153:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:1.0:1787834083.614164:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+28:15646:x1874679382021504:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787834083.614195:0:17143:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787834083.614326:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+28:15646:x1874679382021504:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 164us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834083.614335:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:0.0:1787834083.620840:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834083.621249:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382021632 00000100:00100000:3.0:1787834083.621257:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382021632 00000100:00100000:3.0:1787834083.621372:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:3.0:1787834083.621382:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+28:15646:x1874679382021632:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787834083.621454:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621471:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621483:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621539:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621548:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621554:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621594:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621604:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621611:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834083.621672:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787834083.621677:0:17142:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787834083.621689:0:17142:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621699:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621705:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621712:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621719:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834083.621722:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621738:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621786:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df502e11800) 00010000:00010000:3.0:1787834083.621795:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834083.621800:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621807:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7e00/0x996d2fb20dc1eb89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621821:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621827:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621833:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621838:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834083.621841:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621847:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621855:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8df502e11c00) 00010000:00010000:3.0:1787834083.621858:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834083.621860:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621866:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1eb90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621880:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621892:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621898:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621903:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834083.621906:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621913:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621934:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:3.0:1787834083.621937:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834083.621939:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.621945:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1eb97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834083.622026:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+28:15646:x1874679382021632:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 645us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834083.622034:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:1.0:1787834083.631536:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.634193:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382021888 00000100:00100000:2.0:1787834083.634208:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382021888 00000100:00100000:2.0:1787834083.634366:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:2.0:1787834083.634378:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+28:15646:x1874679382021888:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787834083.634400:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834083.634420:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1eb9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0af expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.634550:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.634566:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.634577:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834083.634588:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787834083.634704:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.634713:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.634720:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.634725:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834083.634729:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.634736:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.634955:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834083.634960:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787834083.634965:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.634973:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1eba5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.635018:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1eb9e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0af expref: 30 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.635041:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df502e11800) 00010000:00010000:2.0:1787834083.635044:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787834083.635048:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1eb9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0af expref: 30 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.635070:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f200, rc 0) 00000100:00100000:2.0:1787834083.635128:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+29:15646:x1874679382021888:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 753us (3600us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787834083.635136:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:1.0:1787834083.639597:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.640079:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382022016 00000100:00100000:0.0:1787834083.640088:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382022016 00000100:00100000:0.0:1787834083.640154:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:0.0:1787834083.640165:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+29:15646:x1874679382022016:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787834083.640201:0:18167:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787834083.640353:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+29:15646:x1874679382022016:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 190us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834083.640361:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:0.0:1787834083.648311:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834083.648475:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382022272 00000100:00100000:1.0:1787834083.648484:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382022272 00000100:00100000:1.0:1787834083.648549:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:1.0:1787834083.648559:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+29:15646:x1874679382022272:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787834083.648578:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834083.648598:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1ebb3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0b6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787834083.650493:0:17141:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:1.0:1787834083.650506:0:17141:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787834083.650618:0:17141:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787834083.651277:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ebba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.651294:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ebba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.651306:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ebba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.651365:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3ac00/0x996d2fb20dc1ebb3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0b6 expref: 32 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.651396:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ebba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0b6 expref: 31 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.651405:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df503f0c700) 00010000:00010000:1.0:1787834083.651409:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787834083.651412:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a400, rc 0) 00000100:00100000:1.0:1787834083.651484:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+31:15646:x1874679382022272:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 2925us (3182us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787834083.651493:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:1.0:1787834083.660363:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834083.660435:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382022528 00000100:00100000:3.0:1787834083.660444:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382022528 00000100:00100000:3.0:1787834083.660546:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:3.0:1787834083.660556:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+31:15646:x1874679382022528:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787834083.660610:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834083.660669:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ebba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0b6 expref: 31 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660689:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df503f0c700) 00010000:00010000:3.0:1787834083.660699:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787834083.660720:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660734:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660744:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660813:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660821:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660828:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660872:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660880:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660886:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660892:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834083.660911:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660920:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660929:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:3.0:1787834083.660932:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834083.660936:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660942:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7200/0x996d2fb20dc1ebc8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660952:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660959:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660964:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660969:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834083.660972:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660978:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.660984:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe6d4bbe (ffff8df502e11c00) 00010000:00010000:3.0:1787834083.660987:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834083.660996:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.661002:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7800/0x996d2fb20dc1ebcf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe6d4bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834083.661106:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+30:15646:x1874679382022528:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 544us (742us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787834083.661113:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:1.0:1787834083.674981:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.681231:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382022656 00000100:00100000:0.0:1787834083.681245:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382022656 00000100:00100000:0.0:1787834083.681302:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:0.0:1787834083.681311:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+30:15646:x1874679382022656:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787834083.681333:0:18167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834083.681355:0:18167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1ebd6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0bd expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.681394:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1ebdd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.681409:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1ebdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.681419:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1ebdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.681551:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677000/0x996d2fb20dc1ebd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0bd expref: 32 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.681577:0:18167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1ebdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0bd expref: 31 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.681586:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:0.0:1787834083.681589:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787834083.681592:0:18167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676c00, rc 0) 00000100:00100000:0.0:1787834083.684185:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+31:15646:x1874679382022656:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 2482us (8820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834083.684198:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:1.0:1787834083.694044:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.697996:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382022912 00000100:00100000:2.0:1787834083.698010:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382022912 00000100:00100000:2.0:1787834083.698194:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:2.0:1787834083.698204:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504777840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+31:15646:x1874679382022912:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787834083.698303:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.698320:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.698338:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787834083.698512:0:17143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787834083.698521:0:17143:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 559611770042ns, next at 560611767459ns, rc = 0 00000004:00010000:2.0:1787834083.698573:0:17143:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000afe9912 reply state 0000000082ca6c5d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.698586:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.698593:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:2.0:1787834083.698595:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787834083.698598:0:17143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787834083.698730:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504777840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+33:15646:x1874679382022912:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 526us (4694us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787834083.698738:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:1.0:1787834083.708579:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.708681:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382023040 00000100:00100000:2.0:1787834083.708692:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382023040 00000100:00100000:2.0:1787834083.708783:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:2.0:1787834083.708803:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+33:15646:x1874679382023040:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787834083.708828:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834083.708849:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0c4 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.708915:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0c4 expref: 34 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.708952:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0c4 expref: 34 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.708972:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:2.0:1787834083.708975:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787834083.708978:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e000, rc 0) 00000100:00100000:2.0:1787834083.709027:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+34:15646:x1874679382023040:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 235us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.709034:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:1.0:1787834083.721194:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.721282:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382023168 00000100:00100000:0.0:1787834083.721292:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382023168 00000100:00100000:0.0:1787834083.721351:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:0.0:1787834083.721361:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2401:x1874679382023168:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787834083.721604:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2401:x1874679382023168:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 244us (418us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787834083.721611:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:1.0:1787834083.735997:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834083.736128:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382023424 00000100:00100000:3.0:1787834083.736139:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382023424 00000100:00100000:3.0:1787834083.736197:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1787834083.736208:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+34:15646:x1874679382023424:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787834083.736452:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+35:15646:x1874679382023424:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 245us (464us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787834083.736460:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1787834083.740218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.740419:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382023680 00000100:00100000:0.0:1787834083.740429:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382023680 00000100:00100000:0.0:1787834083.740490:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:0.0:1787834083.740500:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+35:15646:x1874679382023680:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787834083.740611:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+35:15646:x1874679382023680:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 112us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834083.740634:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:1.0:1787834083.748390:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.748478:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382023808 00000100:00100000:2.0:1787834083.748489:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382023808 00000100:00100000:2.0:1787834083.748545:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:2.0:1787834083.748555:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+35:15646:x1874679382023808:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787834083.748576:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834083.748596:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1ebf2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0cb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.748684:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1ebf9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.748699:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1ebf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.748711:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1ebf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834083.748785:0:17141:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834083.748820:0:17141:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1ebf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.748845:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e200/0x996d2fb20dc1ebf2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0cb expref: 37 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.748862:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1ebf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0cb expref: 36 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.748871:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:2.0:1787834083.748874:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787834083.748877:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:2.0:1787834083.748948:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+36:15646:x1874679382023808:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 395us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.748955:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:1.0:1787834083.752703:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.752837:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382023936 00000100:00100000:2.0:1787834083.752847:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382023936 00000100:00100000:2.0:1787834083.752913:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:2.0:1787834083.752924:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+6:2400:x1874679382023936:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787834083.752942:0:18648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834083.752963:0:18648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0d2 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787834083.752988:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902ee4, blocks: 0x0 00010000:00010000:2.0:1787834083.753008:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1787834083.753013:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834083.753025:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d2 expref: 7 pid: 18648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.753074:0:18648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d2 expref: 7 pid: 18648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.753087:0:18648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4ec00, rc 0) 00000100:00100000:2.0:1787834083.753152:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:2400:x1874679382023936:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 229us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.753160:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:3.0:1787834083.771434:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.771538:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382024192 00000100:00100000:0.0:1787834083.771547:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382024192 00000100:00100000:0.0:1787834083.771613:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:0.0:1787834083.771624:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+36:15646:x1874679382024192:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787834083.772015:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+36:15646:x1874679382024192:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 392us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834083.772022:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:3.0:1787834083.787393:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.787498:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382024320 00000100:00100000:2.0:1787834083.787507:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382024320 00000100:00100000:2.0:1787834083.787566:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:2.0:1787834083.787576:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+36:15646:x1874679382024320:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787834083.791104:0:17121:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787834083.791124:0:17121:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787834083.791192:0:17121:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1787834083.791296:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791308:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791316:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791321:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834083.791326:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791334:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791367:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8df502e11f00) 00010000:00010000:2.0:1787834083.791371:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834083.791376:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791382:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b6600/0x996d2fb20dc1ea39 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791404:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791410:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791416:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791421:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834083.791425:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791430:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791437:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:2.0:1787834083.791439:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834083.791442:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791448:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7400/0x996d2fb20dc1ea40 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791473:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791479:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791485:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791491:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834083.791494:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791500:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791508:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8df6068e6800) 00010000:00010000:2.0:1787834083.791510:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834083.791513:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791518:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1eae8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791533:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791539:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791544:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791554:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834083.791557:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791563:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791571:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834083.791573:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834083.791577:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791583:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676200/0x996d2fb20dc1eb6d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791596:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791602:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791607:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791611:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834083.791614:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791620:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791637:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:2.0:1787834083.791640:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787834083.791643:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.791649:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f200/0x996d2fb20dc1ebe4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834083.791833:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+15:15646:x1874679382024320:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 4255us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.791843:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00010000:00010000:3.0:1787834083.792192:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.792201:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.792207:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.792213:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834083.792216:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.792229:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.792239:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:3.0:1787834083.792242:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787834083.792245:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834083.792251:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676600/0x996d2fb20dc1ea8d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834083.793046:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787834083.793078:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406214400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787834083.793135:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834083.793238:0:19578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406214400 00000100:00100000:1.0:1787834083.793245:0:19578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406214400 00000100:00100000:1.0:1787834083.793293:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787834083.793302:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406214400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787834083.793419:0:19578:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787834083.793422:0:19578:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787834083.793433:0:19578:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787834083.793435:0:19578:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787834084 -> 1787834084 00002000:00010000:1.0:1787834083.793438:0:19578:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787834083.793484:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1874679406214400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (348us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787834083.793492:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1787834083.794859:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df63a97b480/2, rc 0, transno 8589934596 00000100:00100000:3.0:1787834083.794870:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406214400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787834083.800723:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.804494:0:19277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382024448 00000100:00100000:2.0:1787834083.804509:0:19277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382024448 00000100:00100000:2.0:1787834083.804739:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:2.0:1787834083.804765:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:2399:x1874679382024448:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787834083.804876:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:2399:x1874679382024448:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 128us (4232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.804883:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:0.0:1787834083.808177:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834083.808457:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382024704 00000100:00100000:1.0:1787834083.808469:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382024704 00000100:00100000:1.0:1787834083.808561:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1787834083.808572:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+15:15646:x1874679382024704:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787834083.808791:0:17143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834083.808818:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1ebf9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0cb expref: 15 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.808837:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:1.0:1787834083.808842:0:17143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787834083.808873:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.808886:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.808897:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787834083.809204:0:17143:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b22acddf reply state 000000009ce2270f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.809227:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834083.809232:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:1.0:1787834083.809234:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787834083.809237:0:17143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787834083.809342:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+16:15646:x1874679382024704:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 771us (1174us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787834083.809349:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:3.0:1787834083.811705:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.811872:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382024832 00000100:00100000:2.0:1787834083.811881:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382024832 00000100:00100000:2.0:1787834083.811943:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1787834083.811953:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:2400:x1874679382024832:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787834083.812112:0:18649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787834083.812116:0:18649:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787834083 00002000:00010000:2.0:1787834083.812119:0:18649:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787834083 00002000:00010000:2.0:1787834083.812121:0:18649:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787834084 -> 1787834083 00002000:00010000:2.0:1787834083.812137:0:18649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787834083.812207:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+8:2400:x1874679382024832:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 255us (510us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787834083.812216:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1787834083.816312:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834083.818020:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382024960 00000100:00100000:0.0:1787834083.818033:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382024960 00000100:00100000:0.0:1787834083.818112:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:0.0:1787834083.818123:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60365e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+8:2399:x1874679382024960:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787834083.818167:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.818185:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834083.818190:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834083.818196:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.818216:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.818242:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.818263:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.818272:0:18650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.818280:0:18650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834083.818284:0:18650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.818293:0:18650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.818309:0:18650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.818317:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000878abca4/0x996d2fb20dc1ec0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834083.818646:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60365e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+8:2399:x1874679382024960:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 523us (2340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834083.818654:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:0.0:1787834083.820698:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.820882:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382025216 00000100:00100000:2.0:1787834083.820892:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382025216 00000100:00100000:2.0:1787834083.820953:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:2.0:1787834083.820963:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+16:15646:x1874679382025216:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787834083.821037:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.821063:0:18167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f09a expref: 16 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.821073:0:18167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.821104:0:18167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f09a expref: 16 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.821119:0:18167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f09a expref: 16 pid: 17142 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834083.821133:0:18167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a84f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18167:1874679406214528:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787834083.821212:0:18167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787834083.826696:0:18167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a84f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18167:1874679406214528:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787834083.826741:0:18167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834083.827259:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.827467:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382025344 00000100:00100000:2.0:1787834083.827474:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382025344 00010000:00010000:2.0:1787834083.827508:0:18674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f09a expref: 17 pid: 17142 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834083.827544:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:2.0:1787834083.827553:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a978b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+17:2401:x1874679382025344:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787834083.827569:0:18674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834083.827576:0:18674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f09a expref: 17 pid: 17142 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.827587:0:18674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f09a expref: 17 pid: 17142 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.827608:0:18674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676000/0x996d2fb20dc1eb66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f09a expref: 17 pid: 17142 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.827624:0:18674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834083.827630:0:18674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a8 expref: 16 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.827639:0:18674:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.827647:0:18674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.828282:0:18674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.828314:0:18674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834083.828383:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a978b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+16:2401:x1874679382025344:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 829us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.828390:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00010000:00010000:0.0:1787834083.830148:0:18167:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.830173:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.830358:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.830374:0:18167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0c4 expref: 16 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.830382:0:18167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.830413:0:18167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0c4 expref: 16 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.830427:0:18167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0c4 expref: 16 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834083.830440:0:18167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a97a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18167:1874679406214656:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787834083.830513:0:18167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ef16d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834083.835684:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.835797:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382025472 00000100:00100000:2.0:1787834083.835806:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382025472 00010000:00010000:2.0:1787834083.835853:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0c4 expref: 17 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834083.835891:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1787834083.835901:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+17:2400:x1874679382025472:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787834083.835929:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834083.835938:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0c4 expref: 17 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.835954:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0c4 expref: 17 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.835980:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:2.0:1787834083.835986:0:17127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.835996:0:17127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.836026:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.836047:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834083.836111:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+17:2400:x1874679382025472:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 211us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.836119:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00010000:00010000:0.0:1787834083.836964:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e000/0x996d2fb20dc1ebeb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0c4 expref: 16 pid: 17141 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834083.836985:0:18167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a97a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18167:1874679406214656:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787834083.837006:0:18167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.837016:0:18167:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.837031:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787834083.837150:0:18167:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787834083.837260:0:18167:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787834083.837305:0:18167:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787834083.837383:0:18167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a97a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18167:1874679406214784:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787834083.837441:0:18167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834083.837477:0:18167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e181540 going to sleep for 11 seconds 00000100:00100000:3.0:1787834083.838897:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406214784 00000100:00100000:3.0:1787834083.838917:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406214784 00000100:00100000:3.0:1787834083.838979:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787834083.838989:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18167:x1874679406214784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787834083.839117:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18167:x1874679406214784:12345-0@lo:1000:mdt00_003.0 Request processed in 129us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834083.839125:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787834083.839850:0:18167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a97a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18167:1874679406214784:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787834083.840268:0:18167:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787834083.840341:0:18167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a97a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18167:1874679406214912:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787834083.840391:0:18167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834083.840428:0:18167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df606ddeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787834083.841673:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406214912 00000100:00100000:1.0:1787834083.841685:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406214912 00000100:00100000:1.0:1787834083.841743:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787834083.841778:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a978f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18167:x1874679406214912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787834083.841957:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a978f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18167:x1874679406214912:12345-0@lo:1000:mdt00_003.0 Request processed in 207us (1565us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787834083.841964:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787834083.842396:0:18167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a97a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18167:1874679406214912:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787834083.842455:0:18167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842465:0:18167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842472:0:18167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842478:0:18167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787834083.842482:0:18167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842507:0:18167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842585:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:0.0:1787834083.842589:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787834083.842595:0:18167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842602:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677e00/0x996d2fb20dc1ec1c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842633:0:18167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842639:0:18167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842644:0:18167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842649:0:18167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fa00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787834083.842652:0:18167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842658:0:18167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842666:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:0.0:1787834083.842668:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787834083.842674:0:18167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a8 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842828:0:18167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a8 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.842836:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a8 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.842940:0:18167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a8 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834083.842956:0:18167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a84f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18167:1874679406215040:192.168.203.17@tcp:105: 00000100:00100000:2.0:1787834083.843030:0:18167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787834083.847151:0:18167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a84f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18167:1874679406215040:192.168.203.17@tcp:105: 00010000:00010000:2.0:1787834083.847181:0:18167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847191:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fa00/0x996d2fb20dc1eb7b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847293:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847307:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847318:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847328:0:18167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847347:0:18167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847353:0:18167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847359:0:18167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834083.847363:0:18167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847370:0:18167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847382:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834083.847384:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834083.847388:0:18167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847394:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec23 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847403:0:18167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847409:0:18167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847414:0:18167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847419:0:18167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834083.847745:0:18167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847779:0:18167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847789:0:18167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834083.847791:0:18167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787834083.847795:0:18167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.847800:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec15 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18167 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787834083.848143:0:17177:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787834083.848149:0:17177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787834083.848164:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787834083.848175:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787834083.848784:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+19:15646:x1874679382025216:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 27817us (28088us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787834083.848796:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000020:00080000:2.0:1787834083.848804:0:18167:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787834083.851725:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834083.853107:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382025600 00000100:00100000:1.0:1787834083.853120:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382025600 00000100:00100000:1.0:1787834083.853196:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:1.0:1787834083.853205:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df606df4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+19:15645:x1874679382025600:12345-192.168.203.17@tcp:49:dd.0 00000100:00100000:1.0:1787834083.853335:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df606df4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+19:15645:x1874679382025600:12345-192.168.203.17@tcp:49:dd.0 Request processed in 131us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834083.853343:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1787834083.853595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834083.853662:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382025856 00000100:00100000:2.0:1787834083.853668:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382025856 00000100:00100000:2.0:1787834083.853700:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:2.0:1787834083.853708:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+19:15646:x1874679382025856:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787834083.853967:0:17145:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787834083.854000:0:17145:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787834083.854034:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.854063:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.854076:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.854100:0:17145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.854106:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.854112:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.854137:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787834083.854210:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+21:15646:x1874679382025856:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 491us (604us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787834083.854218:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000020:00080000:2.0:1787834083.854221:0:17145:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787834083.854437:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834083.854444:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.854451:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834083.854455:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.854463:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.854476:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:0.0:1787834083.854479:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787834083.854484:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.854491:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1ec2a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834083.854513:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834083.854515:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834083.854517:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834083.873705:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834083.876855:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382025984 00000100:00100000:3.0:1787834083.876888:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382025984 00000100:00100000:2.0:1787834083.877140:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:2.0:1787834083.877153:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a9792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+21:15645:x1874679382025984:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:2.0:1787834083.877183:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834083.877219:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec31 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0d9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.877260:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec38 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.877275:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.877287:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.877421:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1ec31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d9 expref: 23 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.877450:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d9 expref: 22 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834083.877459:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:2.0:1787834083.877462:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787834083.877465:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e800, rc 0) 00000100:00100000:2.0:1787834083.877553:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a9792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+22:15645:x1874679382025984:12345-192.168.203.17@tcp:101:dd.0 Request processed in 403us (3858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834083.877559:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:3.0:1787834084.087710:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834084.087924:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382026112 00000100:00100000:1.0:1787834084.087933:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382026112 00000100:00100000:1.0:1787834084.088018:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1787834084.088043:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+8:2398:x1874679382026112:12345-192.168.203.17@tcp:4:dd.0 00010000:00010000:1.0:1787834084.088091:0:18653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787834084.088092:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787834084.088111:0:18653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d2 expref: 8 pid: 18648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834084.088120:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787834084.088124:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834084.088129:0:18653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834084.088177:0:18653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d2 expref: 8 pid: 18648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834084.088191:0:18653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d2 expref: 8 pid: 18648 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834084.088206:0:18653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18653:1874679406215168:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787834084.088288:0:18653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adb240 going to sleep for 11 seconds 00000100:00100000:2.0:1787834084.093227:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834084.093258:0:18653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18653:1874679406215168:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787834084.093263:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:1.0:1787834084.093286:0:18653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834084.093358:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382026368 00000100:00100000:0.0:1787834084.093366:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382026368 00010000:00010000:0.0:1787834084.093402:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d2 expref: 9 pid: 18648 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834084.093432:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787834084.093443:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787834084.093458:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787834084.093469:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+9:2401:x1874679382026368:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834084.093487:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834084.093508:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d2 expref: 9 pid: 18648 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834084.093520:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d2 expref: 9 pid: 18648 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834084.093545:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1488f60/0x996d2fb20dc1ec00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d2 expref: 9 pid: 18648 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834084.093561:0:17126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834084.093566:0:17126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834084.093572:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834084.093594:0:17126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834084.093619:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787834084.093634:0:18653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834084.093658:0:18653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834084.093668:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+8:2401:x1874679382026368:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 198us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834084.093677:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787834084.093998:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382026240 00000100:00100000:0.0:1787834084.094003:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382026240 00000100:00100000:2.0:1787834084.094856:0:20283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:2.0:1787834084.094870:0:20283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+8:2399:x1874679382026240:12345-192.168.203.17@tcp:4:dd.0 00010000:00010000:2.0:1787834084.094902:0:20283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834084.094916:0:20283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834084.094920:0:20283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834084.094925:0:20283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834084.094936:0:20283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834084.120949:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787834084.196157:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1787834084.196177:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:3.0:1787834084.202496:0:20283:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:3.0:1787834084.202506:0:20283:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787834083 -> 1787834084 00002000:00010000:3.0:1787834084.202509:0:20283:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787834083 -> 1787834084 00002000:00010000:3.0:1787834084.202512:0:20283:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:3.0:1787834084.202529:0:20283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.202542:0:20283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.202551:0:20283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.202559:0:20283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834084.202564:0:20283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.202573:0:20283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.202592:0:20283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.202600:0:20283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1ec46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834084.202707:0:20283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4903173d-3c15-42de-bfe8-e4a9090d66c7+7:2399:x1874679382026240:12345-192.168.203.17@tcp:4:dd.0 Request processed in 107836us (109484us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787834084.202718:0:20283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00000001:00080000:1.0:1787834084.220665:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1787834084.221008:0:18653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:3.0:1787834084.221028:0:18653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.221040:0:18653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.221058:0:18653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.221065:0:18653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3be00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834084.221069:0:18653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.221077:0:18653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.221096:0:18653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834084.221103:0:18653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec1789ae/0x996d2fb20dc1ec3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834084.221222:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382026112:12345-192.168.203.17@tcp:4:dd.0 Request processed in 133178us (133517us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787834084.221233:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00010000:00010000:3.0:1787834085.145698:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787834085.880996:0:20320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1787834086.169081:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834086.741969:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406215296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787834086.742050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834086.742136:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406215296 00000100:00100000:3.0:1787834086.742143:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406215296 00000100:00100000:3.0:1787834086.742216:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787834086.742225:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406215296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787834086.742253:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1787834086.742333:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787834086.742617:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406215296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 391us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834086.742626:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787834086.742692:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406215296:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787834087.192670:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834087.253862:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787834087.253884:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406215424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787834087.253951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834087.253996:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406215552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787834087.254023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834087.254275:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406215424 00000100:00100000:1.0:1787834087.254282:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406215424 00000100:00100000:1.0:1787834087.254522:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787834087.254533:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406215424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787834087.254567:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787834087.254616:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406215424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834087.254623:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787834087.254683:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406215936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787834087.254709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834087.254793:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406215424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787834087.254809:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787834087.254815:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a84de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406215680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787834087.254838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834087.255102:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406215808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787834087.255140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834087.255182:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406215808 00000100:00100000:1.0:1787834087.255187:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406215808 00000100:00100000:1.0:1787834087.255212:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787834087.255218:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406215808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787834087.255237:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787834087.255269:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406215808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834087.255275:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787834087.255320:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406215808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834087.261078:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406215552 00000100:00100000:2.0:1787834087.261089:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406215552 00000100:00080000:2.0:1787834087.261204:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787834087.261240:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406215936 00000100:00100000:2.0:1787834087.261243:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406215936 00000100:00080000:2.0:1787834087.261255:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787834087.261267:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406215680 00000100:00100000:2.0:1787834087.261270:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406215680 00000100:00080000:2.0:1787834087.261279:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787834087.261296:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787834087.262506:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406215552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787834087.262547:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787834087.262631:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406215552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (8607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.262638:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787834087.262666:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787834087.262672:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406215936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787834087.262681:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834087.262706:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406215936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (7996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.262712:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787834087.262729:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787834087.262735:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406215680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787834087.262745:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787834087.262783:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406215680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (7945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.262788:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787834087.263561:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406216448:0@lo:400:kworker.0 00000100:00100000:1.0:1787834087.263613:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834087.263689:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406216960:0@lo:400:kworker.0 00000100:00100000:1.0:1787834087.263714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834087.264202:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787834087.264211:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406216320:0@lo:400:kworker.0 00000100:00100000:1.0:1787834087.264240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834087.264261:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406216832:0@lo:400:kworker.0 00000100:00100000:1.0:1787834087.264279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834087.264297:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406216448 00000100:00100000:0.0:1787834087.264304:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406216448 00000100:00100000:3.0:1787834087.264444:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406216960 00000100:00100000:3.0:1787834087.264448:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406216960 00000100:00100000:3.0:1787834087.264506:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787834087.264515:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406216960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834087.264562:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406216960:12345-0@lo:400:kworker.0 Request processed in 48us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834087.264569:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787834087.264611:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787834087.264647:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787834087.264671:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406216448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834087.264706:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406216448:12345-0@lo:400:kworker.0 Request processed in 81us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834087.264711:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787834087.264844:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406216064:0@lo:400:kworker.0 00000100:00100000:0.0:1787834087.264944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834087.265055:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406216448:0@lo:400:kworker.0 00010000:00080000:1.0:1787834087.265070:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50568f480 x1874679406216960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834087.265085:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406216960:0@lo:400:kworker.0 00000100:00100000:2.0:1787834087.265087:0:19277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406216320 00000100:00100000:2.0:1787834087.265092:0:19277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406216320 00000100:00100000:2.0:1787834087.265234:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787834087.265243:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406216320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834087.265285:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406216320:12345-0@lo:400:kworker.0 Request processed in 43us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.265291:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787834087.265450:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a84de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406215680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787834087.265467:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406215936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787834087.266088:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406216576:0@lo:400:kworker.0 00000100:00100000:0.0:1787834087.266271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834087.266466:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1787834087.266471:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df63a97b480, transno 8589934596 00000004:00080000:0.0:1787834087.266483:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1787834087.266508:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406215552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787834087.266523:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787834087.266528:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406216192:0@lo:400:kworker.0 00000100:00100000:0.0:1787834087.266553:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834087.266616:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406216320:0@lo:400:kworker.0 00000100:00100000:0.0:1787834087.266631:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406216704:0@lo:400:kworker.0 00000100:00100000:0.0:1787834087.266670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834087.266694:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406216832 00000100:00100000:2.0:1787834087.266699:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406216832 00000100:00100000:2.0:1787834087.266765:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406216576 00000100:00100000:2.0:1787834087.266769:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406216576 00000100:00100000:2.0:1787834087.266783:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406216192 00000100:00100000:2.0:1787834087.266785:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406216192 00000100:00100000:2.0:1787834087.266797:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787834087.266803:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406216832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834087.266846:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406216832:12345-0@lo:400:kworker.0 Request processed in 43us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.266852:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787834087.266865:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787834087.266897:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406216576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834087.266933:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406216576:12345-0@lo:400:kworker.0 Request processed in 44us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.266939:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787834087.266950:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787834087.266955:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406216192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834087.266977:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406216192:12345-0@lo:400:kworker.0 Request processed in 22us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.266983:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1787834087.268467:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787834087.268532:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406216832:0@lo:400:kworker.0 00000100:00100000:3.0:1787834087.270014:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406216064 00000100:00100000:3.0:1787834087.270025:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406216064 00000100:00100000:3.0:1787834087.270128:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787834087.270137:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3638:x1874679406216064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834087.270220:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3638:x1874679406216064:12345-0@lo:400:kworker.0 Request processed in 85us (5276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834087.270228:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787834087.271046:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406216064:0@lo:400:kworker.0 00000100:00100000:0.0:1787834087.271063:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406216576:0@lo:400:kworker.0 00000100:00100000:0.0:1787834087.271085:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406216192:0@lo:400:kworker.0 00000100:00100000:0.0:1787834087.271489:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406216704 00000100:00100000:0.0:1787834087.271495:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406216704 00000100:00100000:0.0:1787834087.271577:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787834087.271584:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406216704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834087.271639:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406216704:12345-0@lo:400:kworker.0 Request processed in 55us (4968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834087.271646:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787834087.271675:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50568f0c0 x1874679406216704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834087.271687:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406216704:0@lo:400:kworker.0 00000100:00080000:2.0:1787834087.273504:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787834087.480539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834087.480611:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834087.480647:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834087.480678:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834087.480707:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834087.480734:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834087.480773:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834087.480793:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834087.480814:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834087.480845:0:19578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382026880 00000100:00100000:2.0:1787834087.480856:0:19578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382026880 00000100:00100000:2.0:1787834087.480924:0:19578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382027392 00000100:00100000:2.0:1787834087.480927:0:19578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382027392 00000100:00100000:2.0:1787834087.480981:0:19578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382027008 00000100:00100000:2.0:1787834087.480988:0:19578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382027008 00000100:00100000:2.0:1787834087.481019:0:19578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382027520 00000100:00100000:2.0:1787834087.481024:0:19578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382027520 00000100:00100000:2.0:1787834087.481069:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1787834087.481084:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382026880:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834087.481201:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382026880:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 122us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.481210:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1787834087.481229:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:2.0:1787834087.481236:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382027392:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834087.481261:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382027392:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.481268:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:2.0:1787834087.481280:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1787834087.481286:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382027008:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834087.481310:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382027008:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.481315:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1787834087.481326:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:2.0:1787834087.481331:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382027520:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834087.481354:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382027520:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.481360:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:2.0:1787834087.481380:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382026624 00000100:00100000:2.0:1787834087.481383:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382026624 00000100:00100000:2.0:1787834087.481406:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382027136 00000100:00100000:2.0:1787834087.481409:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382027136 00000100:00100000:2.0:1787834087.481420:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382026752 00000100:00100000:2.0:1787834087.481423:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382026752 00000100:00100000:2.0:1787834087.481445:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382027264 00000100:00100000:2.0:1787834087.481447:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382027264 00000100:00100000:2.0:1787834087.481467:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:2.0:1787834087.481477:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+22:2398:x1874679382026624:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834087.481524:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+22:2398:x1874679382026624:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 48us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.481534:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:2.0:1787834087.481555:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:2.0:1787834087.481566:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2398:x1874679382027136:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834087.481608:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2398:x1874679382027136:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 45us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.481614:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:2.0:1787834087.481626:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:2.0:1787834087.481632:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382026752:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834087.481654:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382026752:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 22us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.481660:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:2.0:1787834087.481672:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00100000:2.0:1787834087.481679:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382027264:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834087.481700:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382027264:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 22us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834087.481706:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00080000:2.0:1787834087.481739:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787834087.481744:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787834087.481780:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787834087.481798:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787834087.487879:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382026496 00000100:00100000:1.0:1787834087.487897:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382026496 00000100:00100000:1.0:1787834087.487987:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 168 00000100:00100000:1.0:1787834087.487998:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2398:x1874679382026496:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834087.488369:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2398:x1874679382026496:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 372us (7659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834087.488377:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 168 Debug log: 42555 lines, 42555 kept, 0 dropped, 0 bad.